-- Logs begin at Mon 2021-11-22 13:04:28 UTC, end at Mon 2021-11-22 13:59:13 UTC. -- Nov 22 13:35:28.600403 dv-cinder-768458-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 13:35:28.610283 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 13:35:28 2021] *** Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: nodename: dv-cinder-768458-14-iscsi Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: machine: x86_64 Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: clock source: unix Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: pcre jit disabled Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: detected number of CPU cores: 4 Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: current working directory: / Nov 22 13:35:28.612241 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: detected binary path: /usr/bin/uwsgi-core Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: your processes number limit is 47680 Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: your memory page size is 4096 bytes Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: detected max file descriptor number: 2048 Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: lock engine: pthread robust mutexes Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: thunder lock: enabled Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 13:35:28.612846 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 13:35:28.657775 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: Python main interpreter initialized at 0x55cf005489c0 Nov 22 13:35:28.657775 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: python threads support enabled Nov 22 13:35:28.657775 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: your server socket listen backlog is limited to 100 connections Nov 22 13:35:28.657775 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: your mercy for graceful operations on workers is 90 seconds Nov 22 13:35:28.658134 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 13:35:28.658211 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: *** Operational MODE: preforking *** Nov 22 13:35:28.658430 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: *** uWSGI is running in multiple interpreter mode *** Nov 22 13:35:28.658430 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: spawned uWSGI master process (pid: 108463) Nov 22 13:35:28.658609 dv-cinder-768458-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 13:35:28.659129 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: spawned uWSGI worker 1 (pid: 108464, cores: 1) Nov 22 13:35:28.659690 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: spawned uWSGI worker 2 (pid: 108465, cores: 1) Nov 22 13:35:28.659833 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 13:35:30.268750 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:35:30.268750 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: from cryptography.utils import int_from_bytes Nov 22 13:35:30.269413 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:35:30.269413 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: from cryptography.utils import int_from_bytes Nov 22 13:35:30.276675 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:35:30.276675 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: from cryptography.utils import int_from_bytes Nov 22 13:35:30.277162 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:35:30.277162 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: from cryptography.utils import int_from_bytes Nov 22 13:35:32.751148 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 13:35:32.751697 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 13:35:32.751884 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 13:35:32.752249 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 13:35:32.752760 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 13:35:32.753151 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.753505 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.753803 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 13:35:32.754154 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.754243 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 13:35:32.754336 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.754457 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.754542 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 13:35:32.754774 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.754883 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 13:35:32.755097 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.755198 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 13:35:32.755416 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.755501 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.755742 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.755835 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756002 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756137 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756320 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756460 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756646 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-14-iscsi {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756793 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.756971 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.757106 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.757857 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758165 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758273 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758485 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758570 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758795 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.758886 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759127 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759222 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759438 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759530 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759775 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-14-iscsi {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.759937 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760335 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760462 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760574 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760685 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760806 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.760975 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761096 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761338 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761466 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761658 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761799 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.761972 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.762104 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.762296 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.762479 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.762630 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.762799 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763007 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763132 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763253 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763409 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763616 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-14-iscsi {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763782 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.763938 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.764078 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.765529 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.765719 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.765901 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766070 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766070 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766389 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766535 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766692 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.766861 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767004 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767144 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-14-iscsi {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767292 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767454 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767605 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767761 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.767918 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768071 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768212 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768212 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768488 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768631 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768781 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.768940 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769083 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769279 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769439 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769625 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769768 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.769963 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770109 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770259 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770400 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770551 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770693 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770834 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.770985 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.771127 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.771276 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.771488 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.771678 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.771851 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772027 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772187 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772340 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772493 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772640 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.772791 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.773564 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.773736 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.773902 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774047 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774215 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774387 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774539 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774683 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774838 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774983 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.774983 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.775298 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.775445 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.775598 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.775750 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.775894 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776039 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776190 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776334 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776485 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776628 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776769 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.776913 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777061 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777252 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777414 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777559 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777701 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777850 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.777993 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778144 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778295 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778437 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778588 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778729 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.778871 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779022 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779164 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779319 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779462 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779628 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779818 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.779993 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780153 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780303 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780447 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780597 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780738 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.780890 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781038 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781181 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781357 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781504 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781664 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781809 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.781953 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782104 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782258 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782401 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782557 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782707 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.782860 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783003 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783155 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783304 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783458 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783603 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783746 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.783897 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784041 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784184 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784352 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784519 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784519 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784808 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.784956 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785117 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785117 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785458 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785643 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785818 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.785990 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786197 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786357 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786502 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786646 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786791 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.786934 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787088 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787238 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787382 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787526 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787678 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787833 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.787985 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.788136 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.788286 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789093 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789339 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789512 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789656 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789819 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.789980 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790140 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790302 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790460 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790683 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790827 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790977 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.790977 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.791265 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.791421 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.791563 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.791713 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.791862 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792011 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792154 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792308 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792451 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792593 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792742 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.792892 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793035 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793191 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793191 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793515 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793666 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793811 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.793811 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794106 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794106 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794388 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794566 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794714 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.794858 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795010 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795154 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795304 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795447 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795590 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795743 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.795895 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796039 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796207 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796362 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796509 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796664 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796813 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.796960 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797113 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797297 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797441 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797597 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797751 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.797892 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798033 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798175 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798318 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798469 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798612 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798753 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.798901 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.798901 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.799180 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.799332 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.799475 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.799623 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.799766 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.799927 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.800097 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.800255 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.800429 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.800572 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.800713 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.800861 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.801011 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.801154 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.801317 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.801477 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:35:32.801631 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.801776 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.801928 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802073 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802217 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802375 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802586 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802740 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802894 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.802894 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803169 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803314 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803471 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803629 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803773 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.803917 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.804090 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.804759 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.804927 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805084 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805270 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805439 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805607 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805763 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.805912 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806064 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806215 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806391 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806534 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806678 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806678 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.806960 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807103 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807245 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807393 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807544 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807688 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807843 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.807987 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808129 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808279 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808422 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808564 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808718 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.808861 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809004 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809154 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809326 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809487 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809633 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809783 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.809928 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810096 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810254 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810432 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810595 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810751 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.810905 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811058 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811213 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811368 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811515 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811672 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811826 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.811975 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812123 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812347 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812502 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812650 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812797 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.812945 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813101 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813289 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813433 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813586 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813736 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.813887 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814044 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814188 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814363 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814507 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814648 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814791 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.814979 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815127 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815274 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815417 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815559 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815714 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.815868 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816017 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816167 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816309 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816478 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816633 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816774 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.816916 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817058 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817219 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817374 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817532 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817684 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817835 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.817980 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818125 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818269 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818428 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818572 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818723 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.818867 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819011 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819165 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819326 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819476 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819621 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819777 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.819921 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.820078 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.820433 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.820595 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.820759 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.820914 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821101 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821307 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821453 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821453 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821738 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.821890 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822033 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822184 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822328 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822479 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822621 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822764 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.822912 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823065 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823208 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823351 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823494 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823686 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823844 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.823987 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824136 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824296 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824450 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824593 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824749 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.824908 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825077 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825252 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825404 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825551 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825712 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.825865 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826017 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826160 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826304 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826459 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826638 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826788 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.826938 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827085 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827233 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827392 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827540 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827693 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.827848 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828001 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828148 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828304 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828452 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828601 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828749 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.828896 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829042 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829220 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829374 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829523 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829668 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829810 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.829951 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830105 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830272 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830435 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830578 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830743 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.830904 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831049 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831234 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831395 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831549 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831700 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831854 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.831996 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832139 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832287 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832437 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832589 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832740 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.832883 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833025 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833166 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833419 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833569 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833724 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.833876 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834018 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834160 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834302 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834450 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834601 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834744 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.834887 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.835030 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.835197 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.835394 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.835594 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.835862 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836008 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836150 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836321 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836477 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836635 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836804 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.836949 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837093 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837271 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837431 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837431 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837721 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.837873 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838018 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838162 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838332 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838477 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838621 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838765 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.838909 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839062 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839207 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839351 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839507 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839661 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839805 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.839958 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840109 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840280 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840439 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840602 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840750 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.840995 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841147 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841341 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841484 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841633 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841776 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.841932 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842076 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842219 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842385 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842528 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842672 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842824 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.842975 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843117 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843260 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843411 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843569 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843714 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843856 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.843998 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844139 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844307 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844461 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844611 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844754 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.844896 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845039 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845182 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845388 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845547 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845700 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845846 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.845990 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846133 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846308 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846454 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846600 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846758 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.846928 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847118 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847267 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847414 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847567 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847744 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.847892 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848048 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848195 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848351 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848499 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848646 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848794 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.848950 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849097 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849304 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849455 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849608 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849752 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.849942 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850087 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850236 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850379 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850537 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850710 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.850853 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.851565 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.851710 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.851853 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852002 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852200 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852345 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852495 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852638 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852783 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.852925 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853081 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853253 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853253 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853549 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853722 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.853867 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854025 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854170 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854314 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854458 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854601 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854755 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.854907 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855051 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855193 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855346 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855517 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855671 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855815 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.855970 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856115 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856260 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856403 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856556 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856701 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.856859 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857039 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857235 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857385 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857542 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857693 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.857848 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858001 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858143 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858302 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858443 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858586 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858728 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.858871 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859023 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859175 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859326 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859469 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859612 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859760 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.859902 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860054 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860205 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860349 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860491 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860651 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860651 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.860962 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861106 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861285 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861434 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861597 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861771 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.861918 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862061 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862206 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862358 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862512 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862664 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862816 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.862961 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863104 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863255 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863399 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863560 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863723 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.863872 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864020 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864168 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864317 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864464 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864623 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864770 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.864917 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865064 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865319 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865469 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865656 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865801 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.865955 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.866105 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.866250 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.866406 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.866614 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.866614 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.867412 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.867567 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.867719 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.867719 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868002 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868002 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868289 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868289 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868562 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868705 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868705 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.868992 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869143 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869310 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869457 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869603 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869760 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.869904 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870061 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870207 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870359 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870504 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870659 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870830 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.870992 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871136 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871280 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871432 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871585 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871750 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.871921 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872077 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872225 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872387 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872536 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872686 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872833 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.872980 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873126 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873334 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873486 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873637 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873780 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.873932 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874075 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874227 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874369 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874512 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874661 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874812 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.874961 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875113 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875262 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875405 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875547 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875710 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.875887 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876032 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876181 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876333 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876484 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876627 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876778 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.876929 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.877072 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.877242 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.877418 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.877813 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.877976 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878128 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878272 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878417 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878567 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878710 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.878864 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879010 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879155 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879299 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879449 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879603 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879748 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.879899 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880053 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880197 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880348 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880501 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880646 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880789 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.880947 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881116 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881297 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881451 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881595 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881737 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.881911 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882059 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882248 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882433 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882580 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882725 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.882869 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883012 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883167 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883311 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883462 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883462 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883735 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.883881 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884034 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884178 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884322 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884471 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884621 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884837 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.884994 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885139 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885341 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885488 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885635 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885795 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.885980 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886134 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886281 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886425 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886577 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886730 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.886875 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887019 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887163 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887307 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887471 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887641 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887788 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.887942 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888139 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888289 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888438 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888598 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888745 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.888898 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889059 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889316 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889482 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889641 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889787 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.889939 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890089 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890235 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890388 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890542 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890694 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890838 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.890990 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891162 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891321 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891466 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891618 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891762 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.891922 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892109 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892266 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892415 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892563 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892717 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.892871 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893025 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893182 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893374 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893518 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893662 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.893804 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894028 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894181 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894332 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894475 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894617 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894798 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.894955 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895099 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895241 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895384 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895533 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895676 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.895833 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896001 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896155 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896298 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896440 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896440 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896723 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.896874 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897023 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897167 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897337 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897511 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897684 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.897886 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898063 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898210 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898362 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898362 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898653 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898797 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.898944 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899089 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899234 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899386 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899530 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899530 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899824 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.899977 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900129 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900287 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900437 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900588 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900732 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.900906 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901053 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901053 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901427 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901571 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901714 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.901862 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902028 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902225 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902384 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902605 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902753 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.902898 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903050 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903200 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903344 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903487 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903629 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903772 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903933 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.903933 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904238 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904383 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904527 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904679 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904822 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.904964 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905106 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905289 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905439 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905439 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905728 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.905885 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906054 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906219 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906364 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906517 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906662 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906814 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.906959 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907103 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907256 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907408 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907553 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907715 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.907885 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908039 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908196 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908350 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908498 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908646 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908794 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.908940 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909097 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909291 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909449 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909593 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909741 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.909885 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910037 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910181 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910324 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910467 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910610 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910754 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.910905 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911049 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911191 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911361 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911522 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911679 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911832 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.911975 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912119 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912290 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912434 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912586 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912730 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.912881 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.913025 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.913166 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.913338 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914021 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914169 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914322 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914496 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914651 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914796 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.914796 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915082 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915234 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915378 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915524 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915700 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.915854 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916005 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916182 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916350 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916499 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916647 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916803 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.916960 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917116 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917116 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917430 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917430 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917705 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.917705 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918022 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918167 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918317 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918460 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918603 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918755 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.918909 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919052 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919195 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919339 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919482 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919634 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919779 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.919928 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920072 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920222 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920375 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920525 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920668 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920820 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.920965 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921107 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921321 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921482 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921645 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921796 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.921942 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922087 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922240 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922420 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922567 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922711 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.922865 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923018 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923172 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923316 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923460 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923604 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923792 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.923947 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924094 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924245 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924402 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924553 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924703 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.924864 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925012 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925161 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925354 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925500 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925644 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925805 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.925950 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926097 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926240 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926411 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926563 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926720 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.926874 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927024 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927168 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927313 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927465 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927609 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927759 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.927919 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928092 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928238 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928392 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928536 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928679 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928831 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.928981 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.929708 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.929867 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930012 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930162 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930307 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930307 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930598 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930755 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.930899 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931050 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931194 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931338 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931491 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931656 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931807 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.931951 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.932107 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.932251 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.932608 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.932773 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.932930 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933079 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933289 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933438 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933595 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933746 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.933890 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934034 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934176 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934326 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934479 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934624 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934780 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.934924 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935067 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935220 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935362 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935504 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935648 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935790 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935933 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.935933 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936228 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936374 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936546 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936693 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936835 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.936993 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937137 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937304 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937450 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937595 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937741 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.937898 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938059 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938243 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938392 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938540 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938698 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.938855 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939002 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939149 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939296 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939453 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939674 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939835 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.939983 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940137 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940283 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940437 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940595 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940743 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.940892 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941045 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941193 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941380 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941522 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941676 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941847 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.941996 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942140 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942140 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942426 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942586 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942749 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.942906 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943050 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943202 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943346 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943494 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943637 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943785 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.943937 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944082 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944224 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944366 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944516 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944679 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944834 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.944985 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945138 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945315 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945464 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945615 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945769 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.945913 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946070 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946215 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946360 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946610 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946763 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.946908 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947054 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947200 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947343 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947506 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947660 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947804 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.947949 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948099 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948259 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948433 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948590 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948737 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.948885 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949033 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949190 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949391 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949536 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949691 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949834 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.949983 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950136 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950281 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950431 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950575 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950718 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.950860 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951013 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951156 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951308 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951453 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951595 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951746 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.951915 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952066 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952223 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952384 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952528 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952696 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.952864 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953009 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953158 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953348 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953503 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953765 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.953914 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954106 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954261 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954430 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954627 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954783 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.954950 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955097 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955290 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955444 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955623 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955776 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.955956 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956106 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956276 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956431 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956587 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956747 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.956916 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957064 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957258 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957406 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957569 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957716 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.957860 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958004 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958147 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958312 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958490 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958635 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958779 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.958921 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959064 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959217 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959373 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959530 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959674 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959818 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.959972 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.960124 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.960771 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961082 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961267 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961428 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961586 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961746 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.961900 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962078 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962253 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962410 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962565 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962720 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.962886 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963046 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963192 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963337 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963491 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963659 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963805 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.963951 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964104 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964250 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964405 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964572 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964720 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.964869 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965019 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965167 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965399 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965545 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965690 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965836 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.965981 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966142 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966292 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966436 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966590 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966744 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.966914 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967071 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967216 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967366 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967509 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967653 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967797 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.967949 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968099 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968244 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968389 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968592 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968745 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.968900 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969044 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969188 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969380 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969527 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969684 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969830 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.969981 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970136 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970282 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970427 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970581 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970727 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.970873 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.971017 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.971284 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.971494 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.971679 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.971844 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.972001 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.972178 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.972427 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.972623 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.972817 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.973004 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.973185 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.973419 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.973632 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.973824 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974007 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974178 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974347 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974527 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974708 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.974902 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.975086 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.975276 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.975455 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.975641 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.975820 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.976561 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.976561 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.976890 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.977071 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.977304 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.977490 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.977490 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.977490 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.978138 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.978329 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.978528 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.978700 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.978853 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979002 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979151 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979299 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979450 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979608 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979765 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.979921 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980069 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980217 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980376 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980533 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980684 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980832 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.980992 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981140 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981331 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981477 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981633 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981633 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.981923 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982067 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982219 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982363 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982532 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982689 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.982847 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983002 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983160 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983304 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983453 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983596 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983755 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.983914 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984059 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984202 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984353 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984498 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984642 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984812 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.984992 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985124 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985277 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985395 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985516 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985656 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985783 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.985907 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986028 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986148 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986280 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986399 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986523 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986665 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986805 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.986944 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987083 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987215 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987360 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987501 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987636 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987755 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.987890 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988012 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988143 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988263 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988391 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988510 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988648 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988769 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.988898 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989018 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989139 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989333 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989461 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989613 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989747 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.989949 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990082 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990280 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990406 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990609 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990735 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.990920 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991051 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991234 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991357 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991571 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991697 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.991920 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992161 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992391 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992536 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992661 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992853 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.992975 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993188 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993494 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993617 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993738 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993860 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.993981 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994140 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994264 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994459 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994583 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994781 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.994913 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995102 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995224 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995422 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995545 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995739 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.995871 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996066 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996186 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996378 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996502 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996694 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.996855 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997026 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997172 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997490 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997618 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997741 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997873 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.997993 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998124 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998244 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998364 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998558 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998682 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.998839 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 13:35:32.998971 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.999182 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.999505 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:32.999829 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.000150 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.000465 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.000799 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.001120 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.001482 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.001798 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.002112 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.002448 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.003010 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.003342 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.003675 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.004007 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.004337 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.004684 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.005003 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.005372 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.005705 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.006023 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.006339 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.006648 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:35:33.006895 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 13:35:33.021579 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_db.sqlalchemy.engines [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.033052 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_db.sqlalchemy.engines [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.091523 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.context [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5a3ccc7-7498-4e42-bdb0-56f137d23b0d(cell1) {{(pid=108464) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 13:35:33.095673 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_concurrency.lockutils [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:35:33.097274 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_concurrency.lockutils [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:35:33.098104 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_concurrency.lockutils [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:35:33.100036 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_concurrency.lockutils [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:35:33.102010 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.context [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5a3ccc7-7498-4e42-bdb0-56f137d23b0d(cell1) {{(pid=108465) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 13:35:33.106216 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:35:33.107793 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:35:33.108615 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:35:33.110364 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_db.sqlalchemy.engines [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.110635 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:35:33.112689 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_db.sqlalchemy.engines [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.123599 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_db.sqlalchemy.engines [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.126040 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_db.sqlalchemy.engines [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.369384 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG oslo_db.sqlalchemy.engines [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.384325 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_db.sqlalchemy.engines [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:35:33.712025 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: WARNING keystonemiddleware.auth_token [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:35:33.718489 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: WARNING keystonemiddleware.auth_token [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:35:33.720157 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: WARNING keystonemiddleware.auth_token [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:35:33.726779 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: WARNING keystonemiddleware.auth_token [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:35:33.941428 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: WARNING keystonemiddleware.auth_token [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:35:33.947203 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: WARNING keystonemiddleware.auth_token [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:35:33.952484 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf005489c0 pid: 108464 (default app) Nov 22 13:35:33.953353 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: WARNING keystonemiddleware.auth_token [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:35:33.954569 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:35:33.955730 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001702 Nov 22 13:35:33.956141 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Mon Nov 22 13:35:33 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:35:33.958487 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: WARNING keystonemiddleware.auth_token [None req-f43857ce-e349-42e9-ba4c-2cb5ee3c6802 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:35:33.963871 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf005489c0 pid: 108465 (default app) Nov 22 13:36:54.546420 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:36:54.547441 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 22 13:36:54.549482 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:36:54 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:36:55.105723 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-2e6232e8-3bc2-4e5c-a0b3-5e770ed36cbb admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:36:55.135631 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-2e6232e8-3bc2-4e5c-a0b3-5e770ed36cbb admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.579562 Nov 22 13:36:55.136685 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Mon Nov 22 13:36:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:36:57.447616 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:36:57.448600 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-791758cf-8232-47a1-886b-f1c82b88a4f1 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 22 13:36:57.449221 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:36:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:36:57.515583 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-4472ecdc-1672-4cb9-b06c-6e8daace7431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:36:57.535405 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:36:57.535405 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:36:57.564861 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-4472ecdc-1672-4cb9-b06c-6e8daace7431 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109315 Nov 22 13:36:57.565765 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:36:57 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:36:57.911258 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-620854d0-dfd1-4908-a074-56dbc4541db2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:36:57.912868 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:36:57.912868 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: warnings.warn(msg) Nov 22 13:36:57.961685 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-620854d0-dfd1-4908-a074-56dbc4541db2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.386891 Nov 22 13:36:57.962190 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Mon Nov 22 13:36:57 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:00.285840 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-4472ecdc-1672-4cb9-b06c-6e8daace7431 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:00.286871 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-4472ecdc-1672-4cb9-b06c-6e8daace7431 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 Nov 22 13:37:00.287286 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:00 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:00.421218 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-8c4363e5-8155-4f9b-8579-ccc10800feae admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:00.439593 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:37:00.439593 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: warnings.warn(msg) Nov 22 13:37:00.461126 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-8c4363e5-8155-4f9b-8579-ccc10800feae admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166505 Nov 22 13:37:00.461971 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:00.475014 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-3e5438ab-0e1f-4cce-b60a-4c8a4e247a97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:00.476515 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:37:00.476515 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:37:00.510575 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-3e5438ab-0e1f-4cce-b60a-4c8a4e247a97 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039965 Nov 22 13:37:00.511156 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Mon Nov 22 13:37:00 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:02.867948 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-8c4363e5-8155-4f9b-8579-ccc10800feae admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:02.868957 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-8c4363e5-8155-4f9b-8579-ccc10800feae admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 22 13:37:02.869543 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:02.930068 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-194626fa-47fb-4257-bde1-f1784447167e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:02.949876 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-194626fa-47fb-4257-bde1-f1784447167e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074074 Nov 22 13:37:02.950428 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:02 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:37:02.963229 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-6b4c1a40-c4af-41c9-ab5d-ef93481a8360 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:02.986782 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-6b4c1a40-c4af-41c9-ab5d-ef93481a8360 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027090 Nov 22 13:37:02.987366 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Mon Nov 22 13:37:02 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:05.327729 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-194626fa-47fb-4257-bde1-f1784447167e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:05.328854 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-194626fa-47fb-4257-bde1-f1784447167e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Nov 22 13:37:05.329294 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:05.387136 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-62e910af-2005-474c-8ea8-de55ad96b6b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:05.404971 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-62e910af-2005-474c-8ea8-de55ad96b6b6 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068768 Nov 22 13:37:05.405552 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:05.418006 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-400e892a-f122-4541-88ec-55993e1733c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:05.440714 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-400e892a-f122-4541-88ec-55993e1733c0 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026304 Nov 22 13:37:05.441285 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Mon Nov 22 13:37:05 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:07.779128 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-62e910af-2005-474c-8ea8-de55ad96b6b6 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:07.780184 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-62e910af-2005-474c-8ea8-de55ad96b6b6 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 22 13:37:07.780792 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:07.840142 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "swap": 0, "name": "ds4G"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:07.860772 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073249 Nov 22 13:37:07.861379 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:07.873817 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-01a1c8ed-e5e6-4f2d-96b0-097eb580e9ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:07.897707 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-01a1c8ed-e5e6-4f2d-96b0-097eb580e9ab admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027722 Nov 22 13:37:07.898369 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Mon Nov 22 13:37:07 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:37:10.296952 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:10.301122 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Nov 22 13:37:10.301122 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:10.362928 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-4572fb8e-9fd9-4064-adc1-db7dd4ae2f96 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:10.388410 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-4572fb8e-9fd9-4064-adc1-db7dd4ae2f96 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083033 Nov 22 13:37:10.388953 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Mon Nov 22 13:37:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:12.730722 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:12.731736 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-af5a9068-784e-4a55-81f1-0ca972c78eb4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 22 13:37:12.732152 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:12.792667 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-039a71c7-32c7-4009-b5b9-0ebf08d050d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:12.810842 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-039a71c7-32c7-4009-b5b9-0ebf08d050d5 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072204 Nov 22 13:37:12.811503 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:12 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:12.823928 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-1ec536ae-52b1-4a81-a3bc-9ba08b39e52f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:12.854667 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-1ec536ae-52b1-4a81-a3bc-9ba08b39e52f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034039 Nov 22 13:37:12.855320 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Mon Nov 22 13:37:12 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:15.161909 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-039a71c7-32c7-4009-b5b9-0ebf08d050d5 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:15.162924 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-039a71c7-32c7-4009-b5b9-0ebf08d050d5 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 22 13:37:15.163339 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:37:15.224107 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-09f4a93d-e2ea-4489-8dab-bc5efcbb52c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:15.246251 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-09f4a93d-e2ea-4489-8dab-bc5efcbb52c7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075728 Nov 22 13:37:15.247076 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:37:15.259793 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-ff944a90-21b3-4e4c-b3eb-90bf47d5b09a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:15.282396 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-ff944a90-21b3-4e4c-b3eb-90bf47d5b09a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026187 Nov 22 13:37:15.282977 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Mon Nov 22 13:37:15 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:17.685047 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-09f4a93d-e2ea-4489-8dab-bc5efcbb52c7 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:17.686086 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-09f4a93d-e2ea-4489-8dab-bc5efcbb52c7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Nov 22 13:37:17.686490 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:17.745763 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-9b3154c2-e500-402b-bfb0-d1a79531076c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 4096}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:17.764995 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-9b3154c2-e500-402b-bfb0-d1a79531076c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071482 Nov 22 13:37:17.765583 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:17 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:37:17.779266 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-77168a4b-31d6-409c-93da-a667c1231570 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:17.801821 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-77168a4b-31d6-409c-93da-a667c1231570 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026716 Nov 22 13:37:17.802389 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Mon Nov 22 13:37:17 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:20.155149 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-9b3154c2-e500-402b-bfb0-d1a79531076c admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:20.156156 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-9b3154c2-e500-402b-bfb0-d1a79531076c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 22 13:37:20.156583 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:20.221814 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-e9c135ee-728b-4c83-9aab-b3d86710b75f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:20.239781 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-e9c135ee-728b-4c83-9aab-b3d86710b75f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076889 Nov 22 13:37:20.240328 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:20.253605 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-82af0f9f-76b8-4a0e-b7cb-ad275b1e3207 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:20.278379 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-82af0f9f-76b8-4a0e-b7cb-ad275b1e3207 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029707 Nov 22 13:37:20.278939 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Mon Nov 22 13:37:20 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:22.639518 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-e9c135ee-728b-4c83-9aab-b3d86710b75f admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:22.640529 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-e9c135ee-728b-4c83-9aab-b3d86710b75f admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 22 13:37:22.640933 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:22.704259 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:22.722597 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075049 Nov 22 13:37:22.723501 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Mon Nov 22 13:37:22 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:22.735630 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-eabb3aa8-14e6-4f58-8ded-76730834715a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:22.761703 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-eabb3aa8-14e6-4f58-8ded-76730834715a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029678 Nov 22 13:37:22.762209 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Mon Nov 22 13:37:22 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:37:44.573755 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:44.574764 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 22 13:37:44.575170 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:37:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:44.635314 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-316191b1-e0d7-4fd4-ab1a-9436e6fc6837 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:44.652451 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-316191b1-e0d7-4fd4-ab1a-9436e6fc6837 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070040 Nov 22 13:37:44.652981 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Mon Nov 22 13:37:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:46.128374 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:46.129318 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-773bb0a0-6d10-4092-9946-04a12fd1b800 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002304 Nov 22 13:37:46.129716 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:46.319347 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-f628b036-eb0c-4a4c-bfdd-9e5f09579600 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:46.324749 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.wsgi [None req-f628b036-eb0c-4a4c-bfdd-9e5f09579600 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 13:37:46.325340 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-f628b036-eb0c-4a4c-bfdd-9e5f09579600 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:46.326140 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-f628b036-eb0c-4a4c-bfdd-9e5f09579600 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057396 Nov 22 13:37:46.326642 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Mon Nov 22 13:37:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 13:37:46.337225 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-767937b4-7589-4eb2-89f4-12b3f3fcd773 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:46.357463 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-767937b4-7589-4eb2-89f4-12b3f3fcd773 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023649 Nov 22 13:37:46.357997 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:46.368065 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-c9ee4e1b-d625-4ab5-a068-4f4ed4e0b42d admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:46.389126 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-c9ee4e1b-d625-4ab5-a068-4f4ed4e0b42d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024427 Nov 22 13:37:46.389616 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:46.399929 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-6def790a-0f7b-40ad-817f-695c48e1f704 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:46.405346 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.wsgi [None req-6def790a-0f7b-40ad-817f-695c48e1f704 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 13:37:46.405913 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-6def790a-0f7b-40ad-817f-695c48e1f704 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:46.406703 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-6def790a-0f7b-40ad-817f-695c48e1f704 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010309 Nov 22 13:37:46.407191 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Mon Nov 22 13:37:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 13:37:47.804000 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-c9ee4e1b-d625-4ab5-a068-4f4ed4e0b42d admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:47.804994 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-c9ee4e1b-d625-4ab5-a068-4f4ed4e0b42d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Nov 22 13:37:47.805418 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:47.994574 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-b163da5b-5438-445e-905c-4c7a61135b4f admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:48.000188 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.wsgi [None req-b163da5b-5438-445e-905c-4c7a61135b4f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 13:37:48.000751 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-b163da5b-5438-445e-905c-4c7a61135b4f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:48.001568 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-b163da5b-5438-445e-905c-4c7a61135b4f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057853 Nov 22 13:37:48.003009 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Mon Nov 22 13:37:47 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 13:37:48.012718 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-f46b86ea-0686-4185-aefb-fd7befaba4b4 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:48.026513 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-f46b86ea-0686-4185-aefb-fd7befaba4b4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017255 Nov 22 13:37:48.027027 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:48.037407 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-8c769f59-02d6-497e-8558-c3391ed2f685 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:48.050505 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-8c769f59-02d6-497e-8558-c3391ed2f685 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 Nov 22 13:37:48.051034 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:37:48.060479 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-556972a8-a397-4523-8c76-bde6ec9da9ed admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:48.065722 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.wsgi [None req-556972a8-a397-4523-8c76-bde6ec9da9ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 13:37:48.066285 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-556972a8-a397-4523-8c76-bde6ec9da9ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:48.067071 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-556972a8-a397-4523-8c76-bde6ec9da9ed admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010040 Nov 22 13:37:48.067562 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Mon Nov 22 13:37:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 13:37:49.453388 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-8c769f59-02d6-497e-8558-c3391ed2f685 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:49.454442 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-8c769f59-02d6-497e-8558-c3391ed2f685 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 22 13:37:49.455344 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:49.644499 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-3ac53732-e8c5-4112-97d4-32ddd143d920 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:49.649722 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.wsgi [None req-3ac53732-e8c5-4112-97d4-32ddd143d920 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 13:37:49.650283 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-3ac53732-e8c5-4112-97d4-32ddd143d920 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:49.651076 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-3ac53732-e8c5-4112-97d4-32ddd143d920 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057825 Nov 22 13:37:49.651579 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:37:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 13:37:49.661910 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-609313ab-ef95-446f-970d-d1c09f568dcf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:49.675004 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-609313ab-ef95-446f-970d-d1c09f568dcf admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017261 Nov 22 13:37:49.675510 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:49.685597 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:49.698561 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016827 Nov 22 13:37:49.699119 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Mon Nov 22 13:37:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:37:49.709281 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-60d4a64f-8fd7-4e43-bca6-64865237d89a admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:49.714399 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.wsgi [None req-60d4a64f-8fd7-4e43-bca6-64865237d89a admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 13:37:49.714954 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-60d4a64f-8fd7-4e43-bca6-64865237d89a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:37:49.715720 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-60d4a64f-8fd7-4e43-bca6-64865237d89a admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010678 Nov 22 13:37:49.716208 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:37:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 22 13:37:51.114298 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:51.115384 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 22 13:37:51.115779 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:51.307223 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-3e2f1b25-1e48-46fd-b517-552a5cebc7f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:51.325118 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-3e2f1b25-1e48-46fd-b517-552a5cebc7f9 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068780 Nov 22 13:37:51.325633 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Mon Nov 22 13:37:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:52.720771 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:52.721935 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Nov 22 13:37:52.722905 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:52.914762 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-b7999f01-ca54-4841-ad78-0d6c21c0956b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:52.931647 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-b7999f01-ca54-4841-ad78-0d6c21c0956b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069492 Nov 22 13:37:52.932180 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Mon Nov 22 13:37:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:54.320637 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:54.321733 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 22 13:37:54.322134 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:54.513412 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-37057027-bd1c-4361-8bf5-d81509fcd9b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:54.532089 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-37057027-bd1c-4361-8bf5-d81509fcd9b5 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070165 Nov 22 13:37:54.532573 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Mon Nov 22 13:37:54 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:55.914646 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:55.915735 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 22 13:37:55.916688 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:56.110545 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-ca71dbbc-22c1-41fe-ad19-ebddc8e4e743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:37:56.128918 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-ca71dbbc-22c1-41fe-ad19-ebddc8e4e743 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070243 Nov 22 13:37:56.129566 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Mon Nov 22 13:37:56 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:37:57.544774 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:57.545860 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Nov 22 13:37:57.546255 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:37:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:37:57.740077 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-4c09b08f-5923-4648-8232-9853453eac87 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:37:57.760540 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-4c09b08f-5923-4648-8232-9853453eac87 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072079 Nov 22 13:37:57.761078 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Mon Nov 22 13:37:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:38:43.922084 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:43.923156 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-6cc1bc72-efea-41eb-a031-5727363a5b9e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Nov 22 13:38:43.923600 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Mon Nov 22 13:38:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:38:43.981046 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-e6018c99-0989-4c42-aa93-0483d25c0147 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:43.999870 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-e6018c99-0989-4c42-aa93-0483d25c0147 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069780 Nov 22 13:38:44.000397 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Mon Nov 22 13:38:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:38:44.024157 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-88044a72-ab8c-4a60-9ec8-94c2c4f2b90c admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:44.031916 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-88044a72-ab8c-4a60-9ec8-94c2c4f2b90c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011389 Nov 22 13:38:44.032427 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Mon Nov 22 13:38:44 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:38:44.043768 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-151adcb2-381f-4af2-8e0d-2ce1fb11c5f3 admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:44.051249 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-151adcb2-381f-4af2-8e0d-2ce1fb11c5f3 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010907 Nov 22 13:38:44.051803 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Mon Nov 22 13:38:44 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:38:44.062860 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-b9c6d30a-9104-4c1b-874a-d3e43e578806 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:44.071146 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-b9c6d30a-9104-4c1b-874a-d3e43e578806 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011656 Nov 22 13:38:44.071669 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Mon Nov 22 13:38:44 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:38:44.084092 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:38:44.091472 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011616 Nov 22 13:38:44.091986 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Mon Nov 22 13:38:44 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:40:12.665478 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-1b3fac26-f8d2-4fda-a3f7-339b7bc91d51 tempest-verify_tempest_config-503115378 tempest-verify_tempest_config-503115378-project] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:40:12.667439 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-1b3fac26-f8d2-4fda-a3f7-339b7bc91d51 tempest-verify_tempest_config-503115378 tempest-verify_tempest_config-503115378-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108956 Nov 22 13:40:12.667966 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 34/69] 10.222.0.31 () {58 vars in 1133 bytes} [Mon Nov 22 13:40:12 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:41:41.242710 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:41.243722 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 22 13:41:41.244119 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 36/70] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:41:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:41:41.497514 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:41.498743 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:41:41.498743 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:41:41.500284 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:41.500722 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:41.501560 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:41.501985 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:41.534441 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-133009a2-d638-4ceb-871e-a6b7a47b052e admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.148228 Nov 22 13:41:41.534995 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 35/71] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:41:41 2021] GET /compute/v2.1/os-services => generated 794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:41:42.957414 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:42.958434 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 22 13:41:42.958826 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 37/72] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:41:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:41:43.161068 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:43.162239 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:41:43.162239 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:41:43.163751 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:43.164189 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:43.165005 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:43.165560 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:43.189875 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-7e708857-3a2c-471a-b609-62b52e01f682 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082964 Nov 22 13:41:43.190420 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 36/73] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:41:43 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:41:55.049703 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:55.050697 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 22 13:41:55.051091 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 38/74] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:41:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:41:55.241186 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:55.242376 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:41:55.242376 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:41:55.243920 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:55.244361 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:55.245153 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:55.245604 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:55.267765 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-9881ab45-d5db-4930-873c-1ad83e6a0fdd admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076799 Nov 22 13:41:55.268303 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 37/75] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:41:55 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:41:56.648198 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: DEBUG nova.api.openstack.wsgi [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] Calling method '>' {{(pid=108464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:56.649207 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: INFO nova.api.openstack.requestlog [None req-29a540ed-5935-4b4d-a322-ae80f6e638cf admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 22 13:41:56.649645 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: [pid: 108464|app: 0|req: 39/76] 10.222.0.31 () {56 vars in 1074 bytes} [Mon Nov 22 13:41:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:41:56.845248 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG nova.api.openstack.wsgi [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] Calling method '>' {{(pid=108465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:41:56.846466 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:41:56.846466 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: warnings.warn(msg) Nov 22 13:41:56.848008 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:56.848445 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:56.849258 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:41:56.849681 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: DEBUG oslo_concurrency.lockutils [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:41:56.871631 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: INFO nova.api.openstack.requestlog [None req-b4c691d9-04d7-4fab-bfbc-99b169dd92c9 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077075 Nov 22 13:41:56.872158 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: [pid: 108465|app: 0|req: 38/77] 10.222.0.31 () {60 vars in 1193 bytes} [Mon Nov 22 13:41:56 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:42:57.060791 dv-cinder-768458-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 22 13:42:57.061690 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: Mon Nov 22 13:42:57 2021 - graceful shutdown triggered... Nov 22 13:42:57.062169 dv-cinder-768458-14-iscsi devstack@n-api.service[108464]: Gracefully killing worker 1 (pid: 108464)... Nov 22 13:42:57.062540 dv-cinder-768458-14-iscsi devstack@n-api.service[108465]: Gracefully killing worker 2 (pid: 108465)... Nov 22 13:42:58.062826 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: worker 1 buried after 1 seconds Nov 22 13:42:58.063232 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: worker 2 buried after 1 seconds Nov 22 13:42:58.063232 dv-cinder-768458-14-iscsi devstack@n-api.service[108463]: goodbye to uWSGI. Nov 22 13:42:58.064376 dv-cinder-768458-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 22 13:42:58.064946 dv-cinder-768458-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 22 13:42:58.067802 dv-cinder-768458-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 13:42:58.077529 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 13:42:58.080121 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 13:42:58 2021] *** Nov 22 13:42:58.080277 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 13:42:58.080411 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 13:42:58.080541 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: nodename: dv-cinder-768458-14-iscsi Nov 22 13:42:58.080655 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: machine: x86_64 Nov 22 13:42:58.080783 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: clock source: unix Nov 22 13:42:58.080893 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: pcre jit disabled Nov 22 13:42:58.081003 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: detected number of CPU cores: 4 Nov 22 13:42:58.081120 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: current working directory: / Nov 22 13:42:58.081326 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: detected binary path: /usr/bin/uwsgi-core Nov 22 13:42:58.081447 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: your processes number limit is 47680 Nov 22 13:42:58.081560 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: your memory page size is 4096 bytes Nov 22 13:42:58.081678 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: detected max file descriptor number: 2048 Nov 22 13:42:58.081801 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: lock engine: pthread robust mutexes Nov 22 13:42:58.082098 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: thunder lock: enabled Nov 22 13:42:58.082296 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 13:42:58.082392 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 13:42:58.128669 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: Python main interpreter initialized at 0x5564ec1d09c0 Nov 22 13:42:58.128669 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: python threads support enabled Nov 22 13:42:58.128669 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: your server socket listen backlog is limited to 100 connections Nov 22 13:42:58.128669 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: your mercy for graceful operations on workers is 90 seconds Nov 22 13:42:58.129113 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 13:42:58.129113 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: *** Operational MODE: preforking *** Nov 22 13:42:58.129462 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: *** uWSGI is running in multiple interpreter mode *** Nov 22 13:42:58.129462 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: spawned uWSGI master process (pid: 122667) Nov 22 13:42:58.129662 dv-cinder-768458-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 13:42:58.130254 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: spawned uWSGI worker 1 (pid: 122684, cores: 1) Nov 22 13:42:58.130761 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: spawned uWSGI worker 2 (pid: 122685, cores: 1) Nov 22 13:42:58.131018 dv-cinder-768458-14-iscsi devstack@n-api.service[122667]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 13:42:59.912056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:42:59.912056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: from cryptography.utils import int_from_bytes Nov 22 13:42:59.912765 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:42:59.912765 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: from cryptography.utils import int_from_bytes Nov 22 13:42:59.915043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:42:59.915043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: from cryptography.utils import int_from_bytes Nov 22 13:42:59.915542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 13:42:59.915542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: from cryptography.utils import int_from_bytes Nov 22 13:43:02.287418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 13:43:02.288020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 13:43:02.288211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 13:43:02.288548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 13:43:02.288815 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 13:43:02.289041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 13:43:02.289517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.289615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 13:43:02.289709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.289804 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 13:43:02.289916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.290175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 13:43:02.290284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.290430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 13:43:02.290534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.290817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.290923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291804 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.291968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.292076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.292191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.292384 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.292496 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.293279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-14-iscsi {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.293453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.293609 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.293766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294225 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294777 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.294977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-14-iscsi {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295095 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.295938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296150 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296673 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.296996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.297224 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.297333 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.297581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.297773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.298034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.298292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.298525 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.298743 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.298982 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.299202 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.299412 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.299634 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.299853 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300080 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-14-iscsi {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300965 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.300965 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.301392 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.301392 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.301890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.301890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.302341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.302560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-14-iscsi {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.302785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.302785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.303175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.303361 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.303550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.303706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.303861 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304210 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.304873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.305027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.305172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.305362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.305521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.305692 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.306064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.306244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.306244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.306722 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.306882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307182 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307792 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.307947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.308108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.308108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309274 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.309971 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310120 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310426 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.310886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311335 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311798 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.311952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312715 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.312866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.313987 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314321 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314472 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314658 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.314980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.315893 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316038 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.316995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317797 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.317953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318106 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318249 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318707 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.318863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319467 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.319921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320199 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320349 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.320946 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321110 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321479 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.321920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322068 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322219 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322373 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322665 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322818 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.322982 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323279 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323580 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.323914 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324370 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324524 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.324668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325002 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.325936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.326950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.327948 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328537 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.328957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.329293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.329452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.329597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.329746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.329902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330423 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330754 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.330902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331065 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331458 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.331897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332352 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.332946 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333449 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.333971 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334128 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334588 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.334891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335336 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.335777 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.335929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.336072 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.336221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.336376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.336521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.336676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.336826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.337067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.337247 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.337410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.337555 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.337713 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.337864 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.338017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.338171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.338325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 13:43:02.338470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.338628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.338772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.338914 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339217 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339374 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339707 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.339857 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340339 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340651 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340806 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.340958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341608 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.341901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342059 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342370 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342826 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.342979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343583 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.343876 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344018 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344771 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.344914 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345554 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.345993 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346436 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346593 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.346901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347074 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347739 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.347892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348489 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348792 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.348936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349098 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.349882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.350914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351524 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.351953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352255 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.352872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353643 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353643 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.353933 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354381 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354524 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.354985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.355688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.355849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356586 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356729 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.356873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357028 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357185 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357524 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357684 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357840 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.357983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358572 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.358858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359000 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359452 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.359860 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.360921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361536 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.361853 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362006 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362151 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362601 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.362946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363385 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.363850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364297 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.364907 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365574 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365736 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.365881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366166 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366611 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366754 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.366897 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.367903 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368786 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.368936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369707 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.369859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.370831 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.371509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.371656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.371799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.371942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372408 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.372855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.373919 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374090 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374237 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374386 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.374988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375719 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.375887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.376901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.377045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.377425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.377609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.377837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.378000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.378145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.378298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.378713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.378866 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379326 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.379951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380102 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380251 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.380891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381739 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.381899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382200 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382678 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382830 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.382979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383616 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.383916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384072 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384232 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.384880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385180 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385363 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385528 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.385997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.386156 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.386307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.386514 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.386666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.386842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387168 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387714 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.387957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.388129 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.388289 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.388631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.388808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.388964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389115 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389336 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.389789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390074 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390223 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.390992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391160 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.391926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.392855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393348 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.393945 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394573 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.394929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395094 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.395876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396333 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396792 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.396943 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397798 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.397798 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398347 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.398979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399136 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399302 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399623 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.399932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400235 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.400998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.401148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.401349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.401510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.401661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.401818 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.402063 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.402220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.402513 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.402695 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.402851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403662 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.403964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404123 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404432 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404748 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.404911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405431 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405760 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.405910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406698 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.406997 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407162 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407489 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.407970 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.408127 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.408387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.408546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.408704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.408855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409358 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.409983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410451 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410608 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.410930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411091 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.411852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412310 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412609 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.412925 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413075 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.413886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.414886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415194 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415352 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.415986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416137 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.416955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.417123 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.417334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.417488 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.418385 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.418626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.418797 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.418948 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419097 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419262 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.419863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.420963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421770 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.421920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422079 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422230 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422381 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422690 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.422848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423005 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.423935 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424384 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.424864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425170 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425708 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.425867 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426025 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426183 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426658 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.426819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427809 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.427968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.428196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.428350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.428509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.428751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.428909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429070 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429238 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.429865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430163 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.430943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431562 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.431868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432184 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432490 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432641 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432798 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.432958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.433126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.433908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.433908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.434434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.434434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.434725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.434884 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435344 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.435978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.436902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437052 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437219 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437219 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437529 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.437865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.438016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.438166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.438316 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.438480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.438637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.439895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.440995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441484 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441643 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441795 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.441945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442268 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442584 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.442906 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443057 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443216 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443525 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.443975 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444307 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444610 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.444990 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445658 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445810 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.445967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.446998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447767 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.447927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448237 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448720 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.448930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.449187 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.449398 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.449618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.449785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.449942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450401 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.450960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.451712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452612 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.452924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453579 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.453888 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454045 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.454951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.455107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.456314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.457657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.457657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.457657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.458124 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.458274 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.458431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.458599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.458749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.459053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.459313 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.459480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.459633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.459791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460234 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.460842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461450 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.461915 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462075 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462235 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462395 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.462854 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.463948 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.464106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.464257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.464408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.465120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.465363 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.465578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.465746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.465905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466527 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466684 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.466985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.467143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.467303 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.467467 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.467979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.468957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.469116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.469306 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.469637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.469798 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.469950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470594 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.470905 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471515 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471739 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.471911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.472852 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.473858 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474022 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.474972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.475130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.475434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.475592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.475750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.475910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476395 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.476866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.477017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.477176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.477351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.477520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.477865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478025 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478344 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.478836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.479137 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.479300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.479453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.479707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.479878 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.480031 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.481123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.481309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.481495 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.481702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.481871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482201 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.482959 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.483877 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484370 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.484996 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.485158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.485375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.485540 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.485699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.485861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486311 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.486930 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487079 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487389 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.487866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488188 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488733 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.488908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.489062 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.489239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.489415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.489572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.489755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490333 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490810 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.490969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491575 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.491883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492205 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492379 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.492864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493385 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.493857 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494340 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.494964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.495259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.495416 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.495567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.495785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.496012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.496239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.496450 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.496605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.496929 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.497975 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.498940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499555 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.499858 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500610 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.500935 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501087 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501087 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.501888 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.502103 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.502268 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.502571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.502763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.502927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.503093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.503252 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.503676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.503843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.503995 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.504147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.504383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.504537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.504695 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.504854 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505574 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505875 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.505875 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506169 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506632 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506783 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.506934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.507883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508365 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508673 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.508989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.509954 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.510104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.510272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.510517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.510682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.510847 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511007 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.511936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.512878 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513028 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513569 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513736 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.513896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514522 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.514986 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515632 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.515945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.516106 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.516258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.516421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.516421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.517230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.517404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.517570 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.517731 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.517898 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518069 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518069 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518838 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.518996 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.519950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.520271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.520431 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.520709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.520877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521210 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521372 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.521990 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.522941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523614 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523765 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.523916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.524873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525031 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525190 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525423 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525729 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.525880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.526838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.527776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.527953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528740 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.528900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529572 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529731 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.529891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.530941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531261 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531724 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.531883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532035 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532195 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532347 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532672 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.532824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.533934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.534084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.534371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.534553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.534718 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.534870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535365 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.535978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.536921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537070 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537289 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537665 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.537985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538779 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.538938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539090 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539412 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.539874 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540685 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.540844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.541930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.542093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.542246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.542397 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.542547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.543298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.543530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.543685 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.543836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544320 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.544966 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545118 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545463 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.545932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546095 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546417 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546569 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546719 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.546870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547339 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547491 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547650 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547809 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.547978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548614 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548614 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.548923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.550215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 13:43:02.551478 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 13:43:02.565959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_db.sqlalchemy.engines [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.575136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_db.sqlalchemy.engines [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.734775 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.context [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5a3ccc7-7498-4e42-bdb0-56f137d23b0d(cell1) {{(pid=122685) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 13:43:02.739346 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:02.739815 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.context [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5a3ccc7-7498-4e42-bdb0-56f137d23b0d(cell1) {{(pid=122684) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 13:43:02.740977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:02.741850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:02.743836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:02.744220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:02.745950 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:02.746837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:02.748796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:02.756766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_db.sqlalchemy.engines [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.759007 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_db.sqlalchemy.engines [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.762533 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_db.sqlalchemy.engines [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.774763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_db.sqlalchemy.engines [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.928733 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_db.sqlalchemy.engines [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:02.944390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_db.sqlalchemy.engines [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 13:43:03.274291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: WARNING keystonemiddleware.auth_token [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:43:03.280467 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: WARNING keystonemiddleware.auth_token [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:43:03.281453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: WARNING keystonemiddleware.auth_token [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:43:03.286911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: WARNING keystonemiddleware.auth_token [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:43:03.631512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: WARNING keystonemiddleware.auth_token [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:43:03.638599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: WARNING keystonemiddleware.auth_token [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 13:43:03.639024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: WARNING keystonemiddleware.auth_token [None req-a4292054-52be-4194-9fc9-a5452e039770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:43:03.643800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: WARNING keystonemiddleware.auth_token [None req-89d481fe-18e0-477f-9e83-b7593697e84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 13:43:03.644584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564ec1d09c0 pid: 122684 (default app) Nov 22 13:43:03.649147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564ec1d09c0 pid: 122685 (default app) Nov 22 13:43:37.879278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9ee9a910-1dce-41b9-a68a-6fb87e7a7d76 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Action: 'create', calling method: .version_select at 0x7f673fabb4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1664334768"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:38.025380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cbd80ab0-019b-4208-ac40-64ac1516c036 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Action: 'create', calling method: .version_select at 0x7f673fab84c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2101872133", "metadata": {"Type": "work"}}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:38.028128 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cbd80ab0-019b-4208-ac40-64ac1516c036 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.029074 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cbd80ab0-019b-4208-ac40-64ac1516c036 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.014637 Nov 22 13:43:38.030176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Nov 22 13:43:37 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1017 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 13:43:38.044115 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-536b8549-e49a-47d4-9190-daab0203e21d tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Action: 'create', calling method: .version_select at 0x7f673fa2b0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1084422835", "metadata": {"Type": "work"}}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:38.045837 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-536b8549-e49a-47d4-9190-daab0203e21d tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.046996 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-536b8549-e49a-47d4-9190-daab0203e21d tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010649 Nov 22 13:43:38.047979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 2/2] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Nov 22 13:43:38 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 13:43:38.059561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4bab7f90-7361-4abc-b958-a50525dd644f tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Action: 'create', calling method: .version_select at 0x7f673fab8550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1489732803", "metadata": {"Type": "work"}}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:38.060875 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4bab7f90-7361-4abc-b958-a50525dd644f tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.061736 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4bab7f90-7361-4abc-b958-a50525dd644f tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007215 Nov 22 13:43:38.066297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 3/3] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Nov 22 13:43:38 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 13:43:38.071001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a85814c8-2050-4174-9155-8b4ab99356ce tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Calling method '.version_select at 0x7f673fa2baf0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:38.587205 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-a85814c8-2050-4174-9155-8b4ab99356ce tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] HTTP exception thrown: Volume tempest-invalid-558979326 could not be found. Nov 22 13:43:38.588954 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a85814c8-2050-4174-9155-8b4ab99356ce tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 404 to user: Volume tempest-invalid-558979326 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.591265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a85814c8-2050-4174-9155-8b4ab99356ce tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-558979326" status: 404 len: 98 microversion: 2.1 time: 0.523501 Nov 22 13:43:38.593117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 4/4] 10.222.0.31 () {58 vars in 1214 bytes} [Mon Nov 22 13:43:38 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-558979326 => generated 98 bytes in 526 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 22 13:43:38.603249 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d6b49a6b-1bb3-4445-9a02-7f6ac4ccc85c tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004868 Nov 22 13:43:38.604551 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 5/5] 10.222.0.31 () {58 vars in 1139 bytes} [Mon Nov 22 13:43:38 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 22 13:43:38.617152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2fd9eb6e-7960-42ed-b3d8-48613ef50c30 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004994 Nov 22 13:43:38.620901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 6/6] 10.222.0.31 () {58 vars in 1136 bytes} [Mon Nov 22 13:43:38 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 13:43:38.633836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f0602cf2-eae2-4c3d-86a0-5b65f137ba70 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Calling method '.version_select at 0x7f673f9ad160>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:38.732932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-f0602cf2-eae2-4c3d-86a0-5b65f137ba70 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] HTTP exception thrown: Volume 159c0713-9a8f-4d2d-8ba1-7d9928a17112 could not be found. Nov 22 13:43:38.733753 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f0602cf2-eae2-4c3d-86a0-5b65f137ba70 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 404 to user: Volume 159c0713-9a8f-4d2d-8ba1-7d9928a17112 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.739648 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f0602cf2-eae2-4c3d-86a0-5b65f137ba70 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/159c0713-9a8f-4d2d-8ba1-7d9928a17112" status: 404 len: 109 microversion: 2.1 time: 0.110222 Nov 22 13:43:38.741591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 7/7] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:43:38 2021] DELETE /compute/v2.1/os-volumes/159c0713-9a8f-4d2d-8ba1-7d9928a17112 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:43:38.752882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-80a21a8f-5ebc-4064-94e2-3a190a0475f1 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Calling method '.version_select at 0x7f673f993ee0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:38.827821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-80a21a8f-5ebc-4064-94e2-3a190a0475f1 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] HTTP exception thrown: Volume 45ecbc88-d77e-4cb4-b6a8-701523d3ec8c could not be found. Nov 22 13:43:38.828711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-80a21a8f-5ebc-4064-94e2-3a190a0475f1 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] Returning 404 to user: Volume 45ecbc88-d77e-4cb4-b6a8-701523d3ec8c could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:38.830421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-80a21a8f-5ebc-4064-94e2-3a190a0475f1 tempest-VolumesNegativeTest-2112907199 tempest-VolumesNegativeTest-2112907199-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/45ecbc88-d77e-4cb4-b6a8-701523d3ec8c" status: 404 len: 109 microversion: 2.1 time: 0.082266 Nov 22 13:43:38.833322 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 8/8] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:38 2021] GET /compute/v2.1/os-volumes/45ecbc88-d77e-4cb4-b6a8-701523d3ec8c => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 13:43:38.933114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9ee9a910-1dce-41b9-a68a-6fb87e7a7d76 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.401549 Nov 22 13:43:38.934058 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 1/9] 10.222.0.31 () {60 vars in 1154 bytes} [Mon Nov 22 13:43:36 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 13:43:38.947055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-46d940f9-27c0-4455-9242-640e6228451a tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f935160>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:39.038873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-46d940f9-27c0-4455-9242-640e6228451a tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 200 len: 345 microversion: 2.1 time: 0.096345 Nov 22 13:43:39.040592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 9/10] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:38 2021] GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:40.053798 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-433b1647-d6b3-4588-9d50-92966363d49d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f9adaf0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:40.097553 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-515716044", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "a84a04f9-b201-43c0-84cd-ce6ec22f409e"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:40.122174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-433b1647-d6b3-4588-9d50-92966363d49d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 200 len: 346 microversion: 2.1 time: 0.072101 Nov 22 13:43:40.129071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 10/11] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:40 2021] GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:40.133562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f079fc3b-8be2-4b61-a557-107871a0c954 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Action: 'create', calling method: .version_select at 0x7f673f993b80>, body: {"snapshot": {"volume_id": "4ab5fd78-ec86-4ad9-b8ac-e1f77de79656", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-209983702"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:40.264827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] validate_networks() for [('a84a04f9-b201-43c0-84cd-ce6ec22f409e', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:43:40.492101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f079fc3b-8be2-4b61-a557-107871a0c954 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.361879 Nov 22 13:43:40.492678 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 11/12] 10.222.0.31 () {60 vars in 1161 bytes} [Mon Nov 22 13:43:40 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:40.502490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-27d00045-f5e2-4e1d-acfc-d38a91276b5c tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f935310>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:40.571637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-27d00045-f5e2-4e1d-acfc-d38a91276b5c tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.072752 Nov 22 13:43:40.573478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 12/13] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:40 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:43:40.583155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e6ab0a13-66bd-4639-a79a-8449510c7432 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f9ad0d0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:40.645512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e6ab0a13-66bd-4639-a79a-8449510c7432 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.065476 Nov 22 13:43:40.646833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 13/14] 10.222.0.31 () {58 vars in 1139 bytes} [Mon Nov 22 13:43:40 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:43:40.659939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6e3fef8f-5bc3-46a1-995a-e886b2157822 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f935dc0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:40.706309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6e3fef8f-5bc3-46a1-995a-e886b2157822 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.052021 Nov 22 13:43:40.709380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 14/15] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:40 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:43:42.126967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1504108697", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "58841093-8ff5-4189-bbff-4ad157ce8f26"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:42.319800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] validate_networks() for [('58841093-8ff5-4189-bbff-4ad157ce8f26', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:43:42.732384 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:43:42.735533 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:43:42.736267 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:43:42.737031 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:43:42.737896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:43:42.786974 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:42.787323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:42.788159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:42.788604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:42.847890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:43:42.909253 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for user bcfdb2c09693488588c0a7b1232739e0 and project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:43:42.924987 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:43:42.930651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:43:43.093042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e5c0f7f7-b7a9-4853-bb1f-7502d1195edf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.169997 Nov 22 13:43:43.094346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 2/16] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:43:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 3172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:43:43.103781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a7cdd18c-ed0b-48ec-833b-ec808fc42ca6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f889820>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:43.171410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a7cdd18c-ed0b-48ec-833b-ec808fc42ca6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.074976 Nov 22 13:43:43.172294 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 3/17] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:43 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:43.179430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6ce81aa0-676d-4457-9d2c-5504d4b6bcea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:43.180733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6ce81aa0-676d-4457-9d2c-5504d4b6bcea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:43.755890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6ce81aa0-676d-4457-9d2c-5504d4b6bcea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:43.776626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6ce81aa0-676d-4457-9d2c-5504d4b6bcea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1217 microversion: 2.1 time: 0.601791 Nov 22 13:43:43.790061 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 4/18] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:43 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1217 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:44.152369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:43:44.152995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:43:44.153278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:43:44.154647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:43:44.155113 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:43:44.183647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:44.183912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a33f40de-3342-48d7-9c46-79e9026ebb93 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e843280>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:44.187714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:44.190323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:44.191508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:44.254930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Getting quotas for project 86d37c16844146be90e42574973a6861. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:43:44.272671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Getting quotas for user f9a688b00f7a4b3b896e313207e71e48 and project 86d37c16844146be90e42574973a6861. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:43:44.285863 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a33f40de-3342-48d7-9c46-79e9026ebb93 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 287 microversion: 2.1 time: 0.106323 Nov 22 13:43:44.286440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 5/19] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:44 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:44.298162 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4c16a8cf-a11d-49f1-873e-5fcfa5abc431 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e851430>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:44.321615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:43:44.344025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:43:44.440091 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4c16a8cf-a11d-49f1-873e-5fcfa5abc431 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 202 len: 0 microversion: 2.1 time: 0.145532 Nov 22 13:43:44.441183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 6/20] 10.222.0.31 () {58 vars in 1253 bytes} [Mon Nov 22 13:43:44 2021] DELETE /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:43:44.450258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-823a8ba8-7cfb-466c-9e41-0a5032597a46 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e851af0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:44.540517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-823a8ba8-7cfb-466c-9e41-0a5032597a46 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.095248 Nov 22 13:43:44.547065 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 7/21] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:44 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:44.586304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b1c9bc0b-534b-4db5-8777-eb435f7cc914 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.920372 Nov 22 13:43:44.593283 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 15/22] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:43:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 2928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 13:43:44.603043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-23c91b1d-6a5f-4cd5-bd67-0a2d8080eae5 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:44.604936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-23c91b1d-6a5f-4cd5-bd67-0a2d8080eae5 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:44.797063 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-77aa02f9-1a60-41ad-a1ee-e9fadf5808e2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:44.798064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-77aa02f9-1a60-41ad-a1ee-e9fadf5808e2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:44.944706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-23c91b1d-6a5f-4cd5-bd67-0a2d8080eae5 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:44.953141 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-23c91b1d-6a5f-4cd5-bd67-0a2d8080eae5 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1215 microversion: 2.1 time: 0.353639 Nov 22 13:43:44.954781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 8/23] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:44 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:44.986991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-77aa02f9-1a60-41ad-a1ee-e9fadf5808e2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:45.038439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-77aa02f9-1a60-41ad-a1ee-e9fadf5808e2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1217 microversion: 2.1 time: 0.243670 Nov 22 13:43:45.057258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 16/24] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:44 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:43:45.553941 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4d911a6f-ff45-4d4a-bab1-bc2ea1ba6ad3 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673f8b08b0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:45.616279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4d911a6f-ff45-4d4a-bab1-bc2ea1ba6ad3 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.066168 Nov 22 13:43:45.621068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 9/25] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:45 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:45.971755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:45.973147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:45.980888 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:45.981813 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:45.982863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:45.983562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:46.067846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:46.068327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:46.078271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:46.079074 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:46.079561 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:46.079921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:46.279743 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:46.280605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:46.299087 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-af764f01-9afc-4ed5-8db3-fcf092f5b346 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1221 microversion: 2.1 time: 0.234828 Nov 22 13:43:46.299431 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b9052c83-755e-445c-a8f9-eac1a1579b7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1219 microversion: 2.1 time: 0.330710 Nov 22 13:43:46.299784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 10/26] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:46 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:46.300424 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 17/27] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:45 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1219 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:46.636519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-260f58ae-9f37-421f-b1d2-0023ddd9ad78 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7c0b80>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:46.708428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-260f58ae-9f37-421f-b1d2-0023ddd9ad78 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 200 len: 286 microversion: 2.1 time: 0.083607 Nov 22 13:43:46.718085 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 11/28] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:46 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:47.321207 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:47.324944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:47.325284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:47.326208 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:47.346289 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:47.348421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:47.348892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:47.360246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:47.360507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:47.363457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:47.363851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:47.369941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:47.523604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:47.540179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8fe65a5e-4d37-4991-a8de-389546af7d51 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1211 microversion: 2.1 time: 0.225144 Nov 22 13:43:47.543835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 18/29] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:47 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1211 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:47.608978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:47.618700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e327099c-6c7f-4990-9894-f3ca29e4d56a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1213 microversion: 2.1 time: 0.304544 Nov 22 13:43:47.622193 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 12/30] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:47 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1213 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:47.723543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6f8d8a77-7e12-424f-a0f8-8d3bc0e30f4d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7d2820>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:47.784599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-6f8d8a77-7e12-424f-a0f8-8d3bc0e30f4d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] HTTP exception thrown: Snapshot 65338789-8590-4c2e-91ba-f8d6b1aaab45 could not be found. Nov 22 13:43:47.784599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6f8d8a77-7e12-424f-a0f8-8d3bc0e30f4d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Returning 404 to user: Snapshot 65338789-8590-4c2e-91ba-f8d6b1aaab45 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:47.784599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6f8d8a77-7e12-424f-a0f8-8d3bc0e30f4d tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45" status: 404 len: 111 microversion: 2.1 time: 0.053946 Nov 22 13:43:47.784599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 19/31] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:43:47 2021] GET /compute/v2.1/os-snapshots/65338789-8590-4c2e-91ba-f8d6b1aaab45 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:43:47.788687 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ed725706-5b6f-428f-81fc-06f83f35b783 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7e1940>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:47.950493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ed725706-5b6f-428f-81fc-06f83f35b783 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 202 len: 0 microversion: 2.1 time: 0.171136 Nov 22 13:43:47.951607 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 20/32] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:43:47 2021] DELETE /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:43:47.960435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-57773953-dd90-4167-9c64-08d940be4c85 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7e1160>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:48.097185 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-57773953-dd90-4167-9c64-08d940be4c85 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 200 len: 345 microversion: 2.1 time: 0.141222 Nov 22 13:43:48.097897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 21/33] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:47 2021] GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:43:48.258803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: .version_select at 0x7f673f8b0430>, body: {"keypair": {"name": "tempest-keypair-1339427919"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:48.351176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:43:48.372457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:43:48.569181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:48.569817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:48.598630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:48.600351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:48.604431 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:48.605381 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:49.043388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:49.060367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-33c68cd1-b48b-4e97-87b6-910cd002167c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1267 microversion: 2.1 time: 0.496320 Nov 22 13:43:49.062522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 22/34] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:48 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1267 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:49.092103 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:49.095285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:49.128652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:49.135740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:49.137708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:49.139024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:49.674822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:43:49.679044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:43:49.722419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:49.730231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0e822b70-b7bb-4ac4-8201-0a91673da4d2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.993879 Nov 22 13:43:49.733281 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-219b85fc-ec40-4f10-b176-a3692e49b309 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1275 microversion: 2.1 time: 0.668154 Nov 22 13:43:49.735219 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 13/35] 10.222.0.31 () {60 vars in 1157 bytes} [Mon Nov 22 13:43:47 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:49.740968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 23/36] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:49 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1275 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:49.749558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b11992a8-9575-4f51-96ff-7d07274457e6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7cf670>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:49.819355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-b11992a8-9575-4f51-96ff-7d07274457e6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] HTTP exception thrown: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. Nov 22 13:43:49.820025 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b11992a8-9575-4f51-96ff-7d07274457e6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Returning 404 to user: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:49.821084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b11992a8-9575-4f51-96ff-7d07274457e6 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 404 len: 109 microversion: 2.1 time: 0.084892 Nov 22 13:43:49.830810 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 14/37] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:49 2021] GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:43:49.839547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-caf35fc5-2bea-44eb-ab11-35e62e5d4333 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e770f70>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:49.891060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-caf35fc5-2bea-44eb-ab11-35e62e5d4333 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] HTTP exception thrown: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. Nov 22 13:43:49.893027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-caf35fc5-2bea-44eb-ab11-35e62e5d4333 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Returning 404 to user: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:49.893264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-caf35fc5-2bea-44eb-ab11-35e62e5d4333 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 404 len: 109 microversion: 2.1 time: 0.058565 Nov 22 13:43:49.894317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 24/38] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:43:49 2021] DELETE /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:43:49.906197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e3e8f180-4f0a-493e-b08e-530a8ab38db8 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Calling method '.version_select at 0x7f673e7cf9d0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:49.962035 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-e3e8f180-4f0a-493e-b08e-530a8ab38db8 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] HTTP exception thrown: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. Nov 22 13:43:49.963078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e3e8f180-4f0a-493e-b08e-530a8ab38db8 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] Returning 404 to user: Volume 4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:43:49.965668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e3e8f180-4f0a-493e-b08e-530a8ab38db8 tempest-VolumesSnapshotsTestJSON-1240256128 tempest-VolumesSnapshotsTestJSON-1240256128-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656" status: 404 len: 109 microversion: 2.1 time: 0.066975 Nov 22 13:43:49.966822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 15/39] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:43:49 2021] GET /compute/v2.1/os-volumes/4ab5fd78-ec86-4ad9-b8ac-e1f77de79656 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:43:50.081591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:50.082606 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:50.116000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:50.116942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:50.125033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:50.128935 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:50.513369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:50.527376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2ee61a3a-aa09-4016-94f0-562527c5606b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1273 microversion: 2.1 time: 0.451088 Nov 22 13:43:50.527968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 25/40] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:50 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1273 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:43:50.752180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:50.753758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:50.772210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:50.785600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:50.788604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:50.789261 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:51.285650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:51.300105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d388ba3b-dc18-4da6-976d-98e7172f151f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1275 microversion: 2.1 time: 0.552618 Nov 22 13:43:51.309974 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 16/41] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:50 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1275 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:51.553880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:51.556244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:51.575562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:51.578644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:51.588578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:51.589688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:51.998260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:52.015356 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4912ad60-4b38-45b4-ba56-cccc2973d106 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1273 microversion: 2.1 time: 0.469573 Nov 22 13:43:52.017309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 26/42] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:51 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1273 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:52.331014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:52.332561 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:52.346179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:52.357378 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:52.360917 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:52.362518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:52.586901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:52.598308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d495beec-e078-4f48-92f7-42d0957e7af1 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1275 microversion: 2.1 time: 0.273939 Nov 22 13:43:52.601651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 17/43] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:52 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:53.035472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:53.037435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:53.051192 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:53.051944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:53.064916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:53.066349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:53.508293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:53.560579 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-90c80686-84aa-489f-8e8a-2426d31965af tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1273 microversion: 2.1 time: 0.497067 Nov 22 13:43:53.561572 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 27/44] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:53 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1273 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:53.623355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:53.623996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:53.641229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:53.641766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:53.653383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:53.653851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:54.313390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-201361034", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2355211-3396-4b01-b0ca-f92016bb8ab5"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:54.450844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] validate_networks() for [('f2355211-3396-4b01-b0ca-f92016bb8ab5', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:43:55.009130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:55.025077 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c61ec0fe-77af-4b87-813f-51d7d75c9464 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 1.408126 Nov 22 13:43:55.029301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 18/45] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:53 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:55.039570 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:55.045427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:55.075166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:55.076030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:55.077914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:55.080010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:56.061060 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:56.068584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-aed17fbf-3f57-4a04-901c-086bde36bb58 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 1.037946 Nov 22 13:43:56.072808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 19/46] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:55 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:56.083030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:56.085481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:56.116528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:56.117362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:56.118364 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:56.119663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:56.270201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:43:56.276385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:43:56.280380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:43:56.280814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:43:56.284445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:43:56.300278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:56.300750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:56.306802 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:56.308629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:56.382107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Getting quotas for project 8d3623b6aa624b48b153f3bb831c6385. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:43:56.387516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Getting quotas for user 209b5f3e5c7f4ea7859e3c5c3e42e8b6 and project 8d3623b6aa624b48b153f3bb831c6385. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:43:56.410402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:43:56.439805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:43:56.628070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5525200d-8d75-4052-bfcd-6625a7b85d76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.001015 Nov 22 13:43:56.632295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 28/47] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:43:53 2021] POST /compute/v2.1/servers => generated 383 bytes in 3006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:43:56.668875 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-16b9a163-d6cd-401c-bbb1-112d4d9fa410 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:56.675419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-16b9a163-d6cd-401c-bbb1-112d4d9fa410 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:56.969023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-16b9a163-d6cd-401c-bbb1-112d4d9fa410 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:56.999214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-16b9a163-d6cd-401c-bbb1-112d4d9fa410 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1221 microversion: 2.1 time: 0.360940 Nov 22 13:43:57.047108 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 29/48] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:56 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1221 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:57.090259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:57.091180 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:57.102549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:57.104850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:57.108415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:57.109056 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:57.693470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:57.707805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2c6d4564-1077-4602-9512-3868a5e81330 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 1.630537 Nov 22 13:43:57.711780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 20/49] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:56 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:43:57.727893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1294058877", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2355211-3396-4b01-b0ca-f92016bb8ab5"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:43:57.911539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] validate_networks() for [('f2355211-3396-4b01-b0ca-f92016bb8ab5', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:43:58.998105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:43:59.016075 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3d4dafc7-b758-424c-a471-aa5b01335d9e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 1.928880 Nov 22 13:43:59.032275 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 30/50] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:57 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:43:59.037029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:43:59.037680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:43:59.067070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:59.067510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:43:59.068332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:43:59.068778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:00.251279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:44:00.254686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:44:00.257497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:44:00.261432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:44:00.270825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:44:00.280412 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:00.284548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:00.285961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:00.287254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:00.315440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Getting quotas for project 8d3623b6aa624b48b153f3bb831c6385. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:44:00.346445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Getting quotas for user 209b5f3e5c7f4ea7859e3c5c3e42e8b6 and project 8d3623b6aa624b48b153f3bb831c6385. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:44:00.392857 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:44:00.398759 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:44:00.579235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:00.589969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-88ada267-095f-4173-8a5a-93a3d0e12014 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.875081 Nov 22 13:44:00.595993 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 21/51] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:43:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 2883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:44:00.604657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1529391488", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7706b4f-e379-4641-9c77-35453cbb2b93"}], "security_groups": [{"name": "tempest-securitygroup--1929938914"}], "key_name": "tempest-keypair-1339427919", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:00.605183 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3eb763c2-f613-4303-8113-1c57dcd68752 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 1.567847 Nov 22 13:44:00.618138 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 31/52] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:43:59 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:00.641277 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:00.641974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:00.688705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:00.692334 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:00.693213 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:00.701516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:02.159891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:02.176886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-dcb71c9c-e019-4977-9b1e-e4e10c4c4a52 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 1.548159 Nov 22 13:44:02.185191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 32/53] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:00 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:02.489671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] validate_networks() for [('e7706b4f-e379-4641-9c77-35453cbb2b93', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:44:02.602057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-7ffe8794-d140-47d2-80c0-1d4d90a5c0cd req-6057ec70-70e7-4a8c-9cbe-81b8a203b10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2fe9ac-97f3-4fc6-b22b-40815195b764", "tag": "e44bb438-71ff-4eeb-a5ea-30e885ca07a2"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:02.605147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:02.605147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:44:02.637674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7ffe8794-d140-47d2-80c0-1d4d90a5c0cd req-6057ec70-70e7-4a8c-9cbe-81b8a203b10d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:02.644686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7ffe8794-d140-47d2-80c0-1d4d90a5c0cd req-6057ec70-70e7-4a8c-9cbe-81b8a203b10d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:02.726504 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-7ffe8794-d140-47d2-80c0-1d4d90a5c0cd req-6057ec70-70e7-4a8c-9cbe-81b8a203b10d service nova] Creating event network-changed:e44bb438-71ff-4eeb-a5ea-30e885ca07a2 for instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 on hv-cinder-76845 Nov 22 13:44:02.727215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7ffe8794-d140-47d2-80c0-1d4d90a5c0cd req-6057ec70-70e7-4a8c-9cbe-81b8a203b10d service nova] Acquired lock "compute-rpcapi-router" {{(pid=122685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 13:44:02.733490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:02.734165 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:02.737111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:02.738560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:02.759967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.compute.rpcapi [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 13:44:02.772169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] Releasing lock "compute-rpcapi-router" {{(pid=122685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 13:44:02.847702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-81b38727-7d76-41af-90cd-c9976d61beef None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.660724 Nov 22 13:44:02.848375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 33/54] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:02.854063 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:02.854956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:02.873980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:02.874439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:02.875246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:02.875698 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:03.050762 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:03.060872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7cfcda7d-1252-486c-b904-87d75b36a7d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1218 microversion: 2.1 time: 0.211192 Nov 22 13:44:03.076208 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 34/55] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:02 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:03.090856 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:03.091676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:03.098513 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:03.103819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:03.104854 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:03.105705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:03.482518 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:03.493077 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1a6d98a5-6abf-4dd6-a798-dc09f9083ca4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.413885 Nov 22 13:44:03.495165 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 35/56] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:03 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:03.502719 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:03.503870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:03.543242 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:03.544003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:03.545020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:03.545647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.106074 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:44:04.107305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:44:04.108204 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:44:04.109328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:44:04.110228 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:44:04.130509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.132138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.135578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.137512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.189710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:44:04.203116 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:44:04.241268 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:44:04.245430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:44:04.393130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c3de6dc4-3e15-4249-a12e-196750762d82 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.795683 Nov 22 13:44:04.395650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 22/57] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:44:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 3799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:44:04.401734 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:04.408860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:04.422250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.432296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.437989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.439328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.608209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:04.617920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d24dd228-2b3e-4482-a029-a5e72c44e9a7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1274 microversion: 2.1 time: 0.221007 Nov 22 13:44:04.618583 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 23/58] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:04 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:04.643546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1f42071e-0f50-4fa9-9072-d4d76ecb4839 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:04.644448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1f42071e-0f50-4fa9-9072-d4d76ecb4839 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:04.816001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:04.828186 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-547f65ee-cb08-41f7-a02b-1b2e7f482203 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 1.331661 Nov 22 13:44:04.832041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 36/59] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:03 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:04.836717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:04.844054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:04.852454 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.855523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:04.861064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:04.861752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.036851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1f42071e-0f50-4fa9-9072-d4d76ecb4839 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:05.048341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1f42071e-0f50-4fa9-9072-d4d76ecb4839 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1238 microversion: 2.1 time: 0.416758 Nov 22 13:44:05.049274 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 24/60] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:04 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1238 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:05.066658 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-23c8c963-a3e0-4b7c-9625-e8139de9c1d0 req-7c404488-0a64-45b0-99e0-c8590dc0510d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc23c4cb-5e26-4a3f-83a2-3f73820458a7", "tag": "50c3ed50-5520-48a4-93ea-11a9469b0a4f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:05.075222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:05.075222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:05.090615 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-23c8c963-a3e0-4b7c-9625-e8139de9c1d0 req-7c404488-0a64-45b0-99e0-c8590dc0510d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.091895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-23c8c963-a3e0-4b7c-9625-e8139de9c1d0 req-7c404488-0a64-45b0-99e0-c8590dc0510d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.117464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-23c8c963-a3e0-4b7c-9625-e8139de9c1d0 req-7c404488-0a64-45b0-99e0-c8590dc0510d service nova] Creating event network-changed:50c3ed50-5520-48a4-93ea-11a9469b0a4f for instance fc23c4cb-5e26-4a3f-83a2-3f73820458a7 on hv-cinder-76845 Nov 22 13:44:05.119813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-23c8c963-a3e0-4b7c-9625-e8139de9c1d0 req-7c404488-0a64-45b0-99e0-c8590dc0510d service nova] Acquired lock "compute-rpcapi-router" {{(pid=122684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 13:44:05.121647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.122738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.123721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.124512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.137816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.compute.rpcapi [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 13:44:05.139027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] Releasing lock "compute-rpcapi-router" {{(pid=122684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 13:44:05.150501 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:05.178204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f65a2a90-8674-4aad-a85b-a9b3d4f0a3a5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.344803 Nov 22 13:44:05.179560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 37/61] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:04 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:05.245635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6a73b444-6b10-4be8-af71-6e12bf0c30ef None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194882 Nov 22 13:44:05.246602 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 25/62] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:05.634677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:05.635891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:05.649524 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.651186 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.652840 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.653585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.847791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:05.848804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:05.862633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.867278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.872015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:05.874902 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:05.977876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:05.984184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ff4c7b1c-a162-4f22-8776-676f503ddb89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1274 microversion: 2.1 time: 0.353084 Nov 22 13:44:05.987629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 38/63] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:05 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1274 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:06.153179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-16e8a445-8a89-4e14-9529-6e7eeceabb3f req-27295848-cd78-4a49-861f-20f1023362d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067f06e1-5203-4223-bdb1-f364f84ccaaa", "tag": "6c00e9e6-d2fc-4a41-934e-e62ab70abc05"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:06.154910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:06.154910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:44:06.171254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-16e8a445-8a89-4e14-9529-6e7eeceabb3f req-27295848-cd78-4a49-861f-20f1023362d3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:06.171710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-16e8a445-8a89-4e14-9529-6e7eeceabb3f req-27295848-cd78-4a49-861f-20f1023362d3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:06.194411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-16e8a445-8a89-4e14-9529-6e7eeceabb3f req-27295848-cd78-4a49-861f-20f1023362d3 service nova] Creating event network-changed:6c00e9e6-d2fc-4a41-934e-e62ab70abc05 for instance 067f06e1-5203-4223-bdb1-f364f84ccaaa on hv-cinder-76845 Nov 22 13:44:06.203096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-16e8a445-8a89-4e14-9529-6e7eeceabb3f req-27295848-cd78-4a49-861f-20f1023362d3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210662 Nov 22 13:44:06.204304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 39/64] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:06.210443 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:06.211341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:06.221435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:06.221435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:06.222065 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:06.222670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:06.340797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:06.356026 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-98a38320-2987-4486-a996-50d041f4f29a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1298 microversion: 2.1 time: 0.149972 Nov 22 13:44:06.356630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 40/65] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:06 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:06.374685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:06.377230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:06.394362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:06.397076 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:06.398106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:06.400312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:06.840350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:06.848628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-93efc784-1722-4af5-9aa2-3883c6eac510 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 1.005172 Nov 22 13:44:06.849452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 26/66] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:05 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:06.982126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:06.997382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6b274d39-cd37-4225-8268-adee1e1223ae tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.629104 Nov 22 13:44:06.998374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 41/67] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:06 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:07.005170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:07.007012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:07.015627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.016936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:07.018183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.019889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:07.232026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:07.242755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c41d76bd-ee20-4cb2-98ce-6e4d1fe09662 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1280 microversion: 2.1 time: 0.242733 Nov 22 13:44:07.245701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 27/68] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:06 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:07.379700 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:07.381495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:07.392545 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.392847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:07.396096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.399220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:07.553071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:07.563185 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-299ad2f3-6cb7-485c-92e5-2d4ec2b8c57d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1296 microversion: 2.1 time: 0.187352 Nov 22 13:44:07.574885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 42/69] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:07 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:07.868049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:07.869438 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:07.879547 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.883369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:07.884967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:07.887405 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.017617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:08.018333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:08.037752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.041780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.043890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.047713 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.217978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:08.226553 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1aa0ad9d-e4d4-433c-b575-8db7dfc72a7c tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.363188 Nov 22 13:44:08.227119 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 28/70] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:07 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:08.263535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:08.265180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:08.274068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.278136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.279158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.280152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.443239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:08.452924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f7504e15-2814-4f12-9f60-41b4eed9d185 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.439554 Nov 22 13:44:08.464352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 43/71] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:08 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:08.586560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:08.590499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:08.592102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:08.596688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.597179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.599303 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a7415635-5a3a-464c-99b5-2e193eb089f7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.340746 Nov 22 13:44:08.599889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 29/72] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:08 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:08.601842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.602529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.741696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-03319127-9fde-4587-8be8-08eea90b289c req-42e14be1-9f89-4d35-a30c-39032d506c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03515ad0-4aa5-4b79-b17c-0182e9a89f98", "tag": "f134f236-0d84-4ad1-ba73-313f831e4543"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:08.743844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:08.743844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:08.756414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-03319127-9fde-4587-8be8-08eea90b289c req-42e14be1-9f89-4d35-a30c-39032d506c35 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:08.758536 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-03319127-9fde-4587-8be8-08eea90b289c req-42e14be1-9f89-4d35-a30c-39032d506c35 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:08.808355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-03319127-9fde-4587-8be8-08eea90b289c req-42e14be1-9f89-4d35-a30c-39032d506c35 service nova] Creating event network-changed:f134f236-0d84-4ad1-ba73-313f831e4543 for instance 03515ad0-4aa5-4b79-b17c-0182e9a89f98 on hv-cinder-76845 Nov 22 13:44:08.818677 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-03319127-9fde-4587-8be8-08eea90b289c req-42e14be1-9f89-4d35-a30c-39032d506c35 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080585 Nov 22 13:44:08.822852 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 30/73] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:44:08.882513 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:08.891189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9eea9195-4afa-4ea8-b575-dfa9b0712837 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.313875 Nov 22 13:44:08.891781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 44/74] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:08 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:09.245734 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:09.247026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:09.254185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.254872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.255870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.256497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.418965 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:09.428148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c4ec8de9-ec83-4e76-b2bf-9dbd8c05c999 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.187901 Nov 22 13:44:09.429049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 31/75] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:09 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:09.475118 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:09.475731 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:09.482437 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.483078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.484047 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.484619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.615928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:09.616535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:09.624512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.624968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.625794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.626238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.687032 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:09.698564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3de87b34-6dd0-46c0-9c3d-6e788faf10fb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.226870 Nov 22 13:44:09.700145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 45/76] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:09 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:09.804369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:09.818071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-203c8e8e-b374-4d29-b02f-8774fdf59910 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.205230 Nov 22 13:44:09.827781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 32/77] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:09 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:09.908133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:09.908916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:09.916464 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.917130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:09.918100 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:09.918678 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.086317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:10.105304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d73efdd7-e6fc-45f0-9268-5b36f6bc213f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.190530 Nov 22 13:44:10.105304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 46/78] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:09 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:10.448510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:10.454431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:10.468236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.468931 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.470005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.470509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.687126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:10.707442 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-681c919a-0dac-4bd6-a6c8-b08cdee5a935 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.261551 Nov 22 13:44:10.708072 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 33/79] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:10 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:10.723182 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:10.723803 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:10.732086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.732695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.733672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.734144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.836205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:10.838214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:10.844303 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.845018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.845949 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:10.847908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:10.896884 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:10.904530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0e0a7602-48cd-4d71-a49c-e58871f73900 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.185789 Nov 22 13:44:10.905445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 47/80] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:10 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:10.998628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:11.006621 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ddf5a41a-a4e6-4352-ba39-d6b7f677f73b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.175232 Nov 22 13:44:11.007376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 34/81] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:10 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:11.111445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:11.112052 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:11.117911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.119023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:11.119807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.120240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:11.725211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:11.726687 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:11.734296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.735064 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:11.736099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.736924 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:11.808710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:11.817228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e4a880cf-6b1c-4f50-b121-798925d6e295 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.709312 Nov 22 13:44:11.818532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 48/82] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:11 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:11.881181 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:11.892009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2397e879-bc6a-4da4-ae78-717fc95e0d57 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.171234 Nov 22 13:44:11.892893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 35/83] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:11 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:11.921858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:11.922677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:11.929443 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.930171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:11.931323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:11.931964 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.023973 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:12.025303 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:12.032003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.033468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.034403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.034917 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.247707 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:12.258700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8467242d-3ba3-4cd3-82b2-26ad7d8a32f5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.238524 Nov 22 13:44:12.263584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 36/84] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:12 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:12.327086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:12.336371 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2e1e349d-dec2-4cb5-86c3-1e1f4358176b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.418132 Nov 22 13:44:12.348189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 49/85] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:11 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:12.823534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-a29103e7-815a-4232-b286-fa57bb5dfd9e req-9c22990d-095e-4876-b6bd-cd4ee135f5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67bbd747-629b-485c-a1b2-e964b23cd5e6", "tag": "240f0463-d6f8-4b28-8e80-f50d6a9dfe1f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:12.825049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:12.825049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:12.836682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:12.837799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-a29103e7-815a-4232-b286-fa57bb5dfd9e req-9c22990d-095e-4876-b6bd-cd4ee135f5a3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.838101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-a29103e7-815a-4232-b286-fa57bb5dfd9e req-9c22990d-095e-4876-b6bd-cd4ee135f5a3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.838330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:12.847299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.847799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.850766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.851215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.866129 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-a29103e7-815a-4232-b286-fa57bb5dfd9e req-9c22990d-095e-4876-b6bd-cd4ee135f5a3 service nova] Creating event network-changed:240f0463-d6f8-4b28-8e80-f50d6a9dfe1f for instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 on hv-cinder-76845 Nov 22 13:44:12.881455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-a29103e7-815a-4232-b286-fa57bb5dfd9e req-9c22990d-095e-4876-b6bd-cd4ee135f5a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058763 Nov 22 13:44:12.882680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 37/86] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:12.909802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:12.910502 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:12.918555 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.919258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:12.928363 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:12.929008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:13.121354 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:13.134886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-393e5f00-c544-44f5-824e-5c6f96f213e2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.301293 Nov 22 13:44:13.135859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 50/87] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:12 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:13.192366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:13.203404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bfb468b9-1a4a-48a2-8d28-56738e0e8cfc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.297582 Nov 22 13:44:13.204233 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 38/88] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:12 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:13.279507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:13.280314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:13.289193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:13.291462 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:13.293697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:13.294934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:13.354870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:13.355503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:13.362744 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:13.363134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:13.369929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:13.370388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:13.592276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:13.599963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-975fd625-1282-477a-8c5f-ef0891aa5ecb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.325116 Nov 22 13:44:13.600540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 51/89] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:13 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:13.600650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:13.611511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bec88aec-8a71-4fe1-81ff-6d8ab9ed2969 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.261432 Nov 22 13:44:13.612092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 39/90] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:13 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:14.154727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:14.155383 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:14.162480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.163112 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.164100 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.164747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.221717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:14.222438 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:14.231494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.231978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.232768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.233259 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.344152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:14.351928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fb499589-539c-4971-a689-fb017465644e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.203337 Nov 22 13:44:14.353833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 52/91] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:14 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:14.617179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:14.618974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:14.635627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.636412 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.639357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.640150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.643996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:14.662607 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-38d97771-fd87-49a2-9f86-31c2afb9ac7d tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.446529 Nov 22 13:44:14.663422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 40/92] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:14 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:14.668779 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:14.669649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:14.687133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.688395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:14.688395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:14.688833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:15.144975 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:15.171260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-de48af3b-ab39-45cd-b42e-8fe3533159e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.496381 Nov 22 13:44:15.172647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 41/93] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:14 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:15.288053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:15.299573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-963d5ddf-92b1-472c-beec-c29ba7d38ef0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.686035 Nov 22 13:44:15.302116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 53/94] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:14 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:15.372855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:15.374189 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:15.389918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:15.391531 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:15.392624 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:15.393285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:15.683472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:15.684902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:15.702307 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:15.703132 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:15.707921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:15.708971 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.004717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:16.021549 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1d97e921-39d1-4ea5-9548-255d20730569 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.652156 Nov 22 13:44:16.021549 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 42/95] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:15 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:16.049815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:16.069911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-acfb0916-2f12-4bf5-9389-2cffde0e26ca tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.392292 Nov 22 13:44:16.072168 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 54/96] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:15 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:16.188811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:16.189457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:16.197530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:16.198457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.201450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:16.202195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.320507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:16.322767 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:16.330322 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:16.330846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.332233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:16.332806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.362030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:16.370023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c00bf996-6c19-443c-8aa1-a293da63bbea tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.184821 Nov 22 13:44:16.370605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 43/97] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:16 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:16.512611 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:16.521351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6f5eec81-3a34-4854-8e48-d2480049eb19 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.206689 Nov 22 13:44:16.523101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 55/98] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:16 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:16.913446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-a3029476-51e0-4560-b4ed-f4ae8fd6737e req-82cd768c-5c6a-4cc6-a6f7-60cfa24e372c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067f06e1-5203-4223-bdb1-f364f84ccaaa", "name": "network-vif-plugged", "status": "completed", "tag": "6c00e9e6-d2fc-4a41-934e-e62ab70abc05"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:16.915042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:16.915042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:16.922577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-a3029476-51e0-4560-b4ed-f4ae8fd6737e req-82cd768c-5c6a-4cc6-a6f7-60cfa24e372c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:16.923022 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-a3029476-51e0-4560-b4ed-f4ae8fd6737e req-82cd768c-5c6a-4cc6-a6f7-60cfa24e372c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:16.934232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-a3029476-51e0-4560-b4ed-f4ae8fd6737e req-82cd768c-5c6a-4cc6-a6f7-60cfa24e372c service nova] Creating event network-vif-plugged:6c00e9e6-d2fc-4a41-934e-e62ab70abc05 for instance 067f06e1-5203-4223-bdb1-f364f84ccaaa on hv-cinder-76845 Nov 22 13:44:16.939233 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-a3029476-51e0-4560-b4ed-f4ae8fd6737e req-82cd768c-5c6a-4cc6-a6f7-60cfa24e372c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087839 Nov 22 13:44:16.939822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 44/99] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:17.044398 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:17.045125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:17.053718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.053869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.055205 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.055702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.090243 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:17.091123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:17.107724 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.108614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.110001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.110781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.325588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:17.337458 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1ef46a55-00e2-4458-8593-db245451a7f4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.299086 Nov 22 13:44:17.338213 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 56/100] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:17 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:17.387245 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:17.388150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:17.394405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.394899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.395686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.396304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.481414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:17.488757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-44a57d4b-7cd7-4648-b136-0cc52998a5a7 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.404151 Nov 22 13:44:17.489373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 45/101] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:17 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:17.539097 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:17.539742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:17.546407 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.546862 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.547834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:17.548274 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:17.579476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:17.591022 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-05351271-cf88-43df-a15f-df5996d1ac09 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.207583 Nov 22 13:44:17.591717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 57/102] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:17 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:17.684790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:17.692124 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5e5f2bdb-4fe3-41d7-9320-9f612f9cb816 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.156693 Nov 22 13:44:17.692699 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 46/103] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:17 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:18.355351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:18.356061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:18.361851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.362301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.363069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.363498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.506256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:18.507012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:18.514376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.514829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.526967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.527592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.542669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:18.551331 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-44e04bb4-55e9-4307-992b-4e378d277486 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.200362 Nov 22 13:44:18.556685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 58/104] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:18 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:18.608452 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:18.609453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:18.618217 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.619054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.619869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.620306 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.702697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:18.712855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8516bb75-b522-401d-b082-303388262240 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.209727 Nov 22 13:44:18.723816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 47/105] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:18 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:18.723816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:18.723816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:18.724380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.725057 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.726374 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.726824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.797114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:18.806427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-39c236ad-b185-4fe7-b21b-5b318f0de81c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.201909 Nov 22 13:44:18.807418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 59/106] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:18 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:18.881834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:18.889451 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6dc9822f-d066-43c8-a25d-43c57dc04b68 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.175005 Nov 22 13:44:18.890012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 48/107] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:18 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:18.954913 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc23c4cb-5e26-4a3f-83a2-3f73820458a7", "name": "network-vif-plugged", "status": "completed", "tag": "50c3ed50-5520-48a4-93ea-11a9469b0a4f"}, {"server_uuid": "ff2fe9ac-97f3-4fc6-b22b-40815195b764", "name": "network-vif-plugged", "status": "completed", "tag": "e44bb438-71ff-4eeb-a5ea-30e885ca07a2"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:18.956623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:18.956623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:44:18.964896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:18.965307 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:18.982400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] Creating event network-vif-plugged:50c3ed50-5520-48a4-93ea-11a9469b0a4f for instance fc23c4cb-5e26-4a3f-83a2-3f73820458a7 on hv-cinder-76845 Nov 22 13:44:18.983221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] Creating event network-vif-plugged:e44bb438-71ff-4eeb-a5ea-30e885ca07a2 for instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 on hv-cinder-76845 Nov 22 13:44:18.990902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-091e66a7-4021-4ac0-8f20-addee9138310 req-c3b91192-5491-475c-b9fa-3bb030d416e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039540 Nov 22 13:44:18.992019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 60/108] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:18 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:19.567788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:19.568404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:19.574723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.575178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.575959 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.579535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.712848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:19.720271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f4483ef2-9a85-4b29-8ac6-43fe2544eb41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.155990 Nov 22 13:44:19.720848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 49/109] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:19 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:19.731605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:19.732312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:19.739085 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.739456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.740249 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.740674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.826831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:19.827548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:19.835068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.835521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.836823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.837556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.901730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:19.908946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-44d9a17b-58be-437c-b9c9-c94a71beac77 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.181482 Nov 22 13:44:19.909737 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 61/110] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:19 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:19.922418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:19.923025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:19.928745 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.929480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.930790 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:19.931404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:19.998256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:20.005825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dca8f164-578d-449b-9d07-f149c84d6d1b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.184426 Nov 22 13:44:20.006392 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 50/111] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:19 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:20.081998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:20.089591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bb436ca3-f17b-4d6f-b4e4-9ffa61ae8e94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.178883 Nov 22 13:44:20.090155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 62/112] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:19 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:20.737270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:20.737889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:20.744693 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:20.745148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:20.745959 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:20.746401 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:20.877699 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:20.886184 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cfc8ad86-cd53-4f31-b1c3-ed923cfe83cc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.152526 Nov 22 13:44:20.886757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 51/113] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:20 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:20.928998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:20.930335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:20.937491 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:20.937977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:20.938815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:20.939254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.023456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:21.024839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:21.032360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.032999 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.033832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.034275 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.125626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:21.135876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-380e1fea-c128-488a-bed1-36f5b7f29b7f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.211873 Nov 22 13:44:21.137238 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 63/114] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:20 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:21.142325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:21.143047 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:21.152622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.153181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.154320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.154932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.324668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:21.334018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e12115f6-d942-442b-b902-14bd534c5adf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.314000 Nov 22 13:44:21.334964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 52/115] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:21 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:21.423083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:21.437696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-be8e814a-1529-4678-872d-a3b15ddc5a9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.299253 Nov 22 13:44:21.438504 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 64/116] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:21 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:21.903249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:21.904051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:21.910148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.910556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:21.911376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:21.911779 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.086088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:22.096390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-72120ef2-a086-4eae-bce5-d3d1a5ef40df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.197142 Nov 22 13:44:22.097168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 53/117] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:21 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:22.152401 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:22.153146 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:22.163131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.163934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.164924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.166212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.346642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:22.359545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:22.360628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:22.361362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9d227357-63db-40fb-b86e-67d12e394c9b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1315 microversion: 2.1 time: 0.213185 Nov 22 13:44:22.369396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 65/118] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:22 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:22.375425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.376145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.377148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.377770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.455347 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:22.455886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:22.462968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.463626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.464539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:22.465221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:22.529217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:22.537215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-167773b6-2bed-4237-8418-742f764fbe1a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1317 microversion: 2.1 time: 0.181312 Nov 22 13:44:22.537790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 54/119] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:22 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:22.622754 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:22.632566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ec263627-56c1-4047-9267-3ccf203eae04 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.180871 Nov 22 13:44:22.633328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 66/120] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:22 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:23.062735 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-bf6173da-c26f-491f-a09a-4dc6160f4b37 req-ce244f9f-cbd5-422d-8cb4-626ea7668d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03515ad0-4aa5-4b79-b17c-0182e9a89f98", "name": "network-vif-plugged", "status": "completed", "tag": "f134f236-0d84-4ad1-ba73-313f831e4543"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:23.064345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:23.064345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:23.071983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-bf6173da-c26f-491f-a09a-4dc6160f4b37 req-ce244f9f-cbd5-422d-8cb4-626ea7668d7b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.072582 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-bf6173da-c26f-491f-a09a-4dc6160f4b37 req-ce244f9f-cbd5-422d-8cb4-626ea7668d7b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.083584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-bf6173da-c26f-491f-a09a-4dc6160f4b37 req-ce244f9f-cbd5-422d-8cb4-626ea7668d7b service nova] Creating event network-vif-plugged:f134f236-0d84-4ad1-ba73-313f831e4543 for instance 03515ad0-4aa5-4b79-b17c-0182e9a89f98 on hv-cinder-76845 Nov 22 13:44:23.089438 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-bf6173da-c26f-491f-a09a-4dc6160f4b37 req-ce244f9f-cbd5-422d-8cb4-626ea7668d7b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030564 Nov 22 13:44:23.090143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 55/121] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:23.119226 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:23.119978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:23.126227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.126786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.127706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.128510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.275615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:23.292076 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-818cff77-1441-4237-93be-6718e0257532 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.177337 Nov 22 13:44:23.293596 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 67/122] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:23 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:23.380229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:23.380932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:23.387640 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.388099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.388997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.389345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.537388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:23.545758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3678ce1c-32d2-474f-bbd0-c1b30c4fffcc tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1502 microversion: 2.1 time: 0.169696 Nov 22 13:44:23.546330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 56/123] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:23 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:23.556333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:23.556952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:23.566699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.567153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.569365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.569489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.650935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:23.651964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:23.658445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.659210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.660221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:23.660865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:23.733902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:23.743239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b4c42a97-d79f-428c-b7fe-438a4a13fc63 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1506 microversion: 2.1 time: 0.191656 Nov 22 13:44:23.743825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 68/124] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:23 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:23.814654 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:23.835691 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ddb314c5-5660-4e3b-a9a9-a958d9529619 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.188785 Nov 22 13:44:23.839186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 57/125] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:23 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:24.308822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:24.309400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:24.315509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:24.315964 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:24.316749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:24.317189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:24.444474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:24.451856 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-039a9b6b-d887-46ad-ac19-8cb9fbf9369c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.146852 Nov 22 13:44:24.452426 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 69/126] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:24 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:24.852651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:24.853227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:24.859437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:24.859891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:24.860676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:24.861114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:24.993523 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:25.001677 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-25245269-63c1-4bcb-9d4b-e8316835b5ab tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.152666 Nov 22 13:44:25.002255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 58/127] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:24 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:25.108545 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-a3b88a7b-9f72-4f80-96bb-2d10f6f162b8 req-c2fcd34d-f01e-4400-90a4-8a3649071a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bbd747-629b-485c-a1b2-e964b23cd5e6", "name": "network-vif-plugged", "status": "completed", "tag": "240f0463-d6f8-4b28-8e80-f50d6a9dfe1f"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:25.110057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:25.110057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:44:25.116998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-a3b88a7b-9f72-4f80-96bb-2d10f6f162b8 req-c2fcd34d-f01e-4400-90a4-8a3649071a32 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:25.117474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-a3b88a7b-9f72-4f80-96bb-2d10f6f162b8 req-c2fcd34d-f01e-4400-90a4-8a3649071a32 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:25.129316 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-a3b88a7b-9f72-4f80-96bb-2d10f6f162b8 req-c2fcd34d-f01e-4400-90a4-8a3649071a32 service nova] Creating event network-vif-plugged:240f0463-d6f8-4b28-8e80-f50d6a9dfe1f for instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 on hv-cinder-76845 Nov 22 13:44:25.134254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-a3b88a7b-9f72-4f80-96bb-2d10f6f162b8 req-c2fcd34d-f01e-4400-90a4-8a3649071a32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029212 Nov 22 13:44:25.135566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 70/128] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:44:25.467802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:25.468406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:25.474263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:25.474705 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:25.475464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:25.475894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:25.603114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:25.611295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-30733d35-abc3-4393-8dc4-3cd6a287db12 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.147090 Nov 22 13:44:25.611868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 59/129] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:25 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:26.019804 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:26.020509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:26.027267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:26.027717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:26.028495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:26.028933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:26.165698 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:26.173870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2338084f-f78e-4338-b4a3-155139f7e6c7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.158139 Nov 22 13:44:26.174425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 71/130] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:26 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:26.629170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:26.629865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:26.636013 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:26.636525 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:26.637335 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:26.637773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:26.807182 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:26.815430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-889cdd5f-ecda-49b3-9ede-6f42ed5a3326 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.190279 Nov 22 13:44:26.816076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 60/131] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:26 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:27.044701 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c233e4b-3566-4b4c-9afa-80eddb53c137"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:27.045781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:27.051421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.051861 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.052622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.053052 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.192710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:27.193052 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:27.201217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.201823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.202628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.203069 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.356711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:27.364323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-801ceecc-a816-44af-bc66-a4694e131c34 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1322 microversion: 2.1 time: 0.177259 Nov 22 13:44:27.365256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 61/132] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:27 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:27.468393 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-377d5f6a-2ca0-4984-bc0e-e11eba83401a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "POST /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427162 Nov 22 13:44:27.469035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 72/133] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:44:27 2021] POST /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:27.832791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:27.833440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:27.839867 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.840324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.841107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:27.841575 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:27.983390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:27.990738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-354d092d-31b0-47a5-a9c6-19f58c9adb64 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1364 microversion: 2.1 time: 0.161490 Nov 22 13:44:27.991317 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 62/134] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:27 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:28.294153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cef03ad-c09f-4ee1-ad08-0af42c932ea8"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:28.295486 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:28.302116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.302581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.303352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.303783 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.383698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:28.384430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:28.396674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.397111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.398666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.399521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.614849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:28.623498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0a5e2e3a-ca07-4425-a4f8-5e116577e32b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1515 microversion: 2.1 time: 0.245265 Nov 22 13:44:28.624678 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 63/135] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:28 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:28.647082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:28.647082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:28.656462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.656989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.657933 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.658953 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.685241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3a8c5ccc-ca57-4976-b516-431bb6ebe8db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396079 Nov 22 13:44:28.686228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 73/136] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:44:28 2021] POST /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:28.742378 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'flavor' on Instance uuid 03515ad0-4aa5-4b79-b17c-0182e9a89f98 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:44:28.898308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9cf237a8-d200-4083-895b-bcc1efbdbb5b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98/action" status: 200 len: 32 microversion: 2.1 time: 0.260253 Nov 22 13:44:28.899856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 64/137] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:28 2021] POST /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:44:28.910216 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:28.910902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:28.918250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.918676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:28.919455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:28.920043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:29.013376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:29.014836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:29.034981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:29.036466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:29.042508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:29.044549 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:29.105832 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:29.114784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-96e1a971-ceea-442c-a4d7-e1df79ba75d3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.209026 Nov 22 13:44:29.125809 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 74/138] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:28 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:29.375871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:29.384480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-947b840a-775f-425a-ac8d-f28940d3b3b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1550 microversion: 2.1 time: 0.379866 Nov 22 13:44:29.385479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 65/139] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:29 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1550 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:29.403200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:29.403727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:29.415152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:29.415152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:29.415152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:29.415152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:29.535522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ed764a6d-dcf1-4d40-b659-79ffffecca04 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137561 Nov 22 13:44:29.536440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 75/140] 10.222.0.31 () {58 vars in 1274 bytes} [Mon Nov 22 13:44:29 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:30.133229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:30.133838 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:30.143277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:30.144436 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:30.145319 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:30.145926 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:30.324892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:30.332305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f56cfec0-0b09-4006-b2ec-a387860aef94 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.202563 Nov 22 13:44:30.332885 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 66/141] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:30 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:31.131492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:31.132936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-21583ff5-b11e-4f9c-bb6f-5ea092edf1e1 req-83804eab-f0ac-472d-8cfe-bda3cac8e77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67bbd747-629b-485c-a1b2-e964b23cd5e6", "tag": "240f0463-d6f8-4b28-8e80-f50d6a9dfe1f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:31.133617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:31.134899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:31.134899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:31.146665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-21583ff5-b11e-4f9c-bb6f-5ea092edf1e1 req-83804eab-f0ac-472d-8cfe-bda3cac8e77a service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:31.146665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-21583ff5-b11e-4f9c-bb6f-5ea092edf1e1 req-83804eab-f0ac-472d-8cfe-bda3cac8e77a service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:31.146930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:31.146930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:31.146930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:31.150048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:31.157831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-21583ff5-b11e-4f9c-bb6f-5ea092edf1e1 req-83804eab-f0ac-472d-8cfe-bda3cac8e77a service nova] Creating event network-changed:240f0463-d6f8-4b28-8e80-f50d6a9dfe1f for instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 on hv-cinder-76845 Nov 22 13:44:31.163209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-21583ff5-b11e-4f9c-bb6f-5ea092edf1e1 req-83804eab-f0ac-472d-8cfe-bda3cac8e77a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Nov 22 13:44:31.163821 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 67/142] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:44:31.241260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-25798563-52b0-4e2c-96dc-747832d18d5a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.114032 Nov 22 13:44:31.242070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 76/143] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:31 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:31.352135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:31.352928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:31.362445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:31.362661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:31.363900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:31.364653 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:31.714849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:31.740352 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-421f40c2-ab73-4f48-8362-cee35037c6a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.392830 Nov 22 13:44:31.740912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 68/144] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:31 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:32.253084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:32.255716 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:32.263342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:32.263789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:32.264776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:32.266114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:32.343976 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e4be905e-b211-42fb-ac56-7b57fc58199f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.094547 Nov 22 13:44:32.351863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 77/145] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:32 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:32.765589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:32.766329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:32.774990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:32.776243 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:32.777049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:32.777535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:33.176971 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:33.185846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e838e76b-bc1f-4f79-a597-fcb09f53b89b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.430027 Nov 22 13:44:33.196191 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 69/146] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:32 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:33.357512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:33.358511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:33.365609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:33.365950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:33.366794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:33.367240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:34.202541 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:34.203250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:34.209395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:34.209879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:34.210668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:34.211164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:34.350020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:34.358051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a5b9a989-d54b-424b-ad61-defd0db5b8b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.159089 Nov 22 13:44:34.358636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 70/147] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:34 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:35.375534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:35.376342 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:35.382398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:35.382918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:35.383931 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:35.384602 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:35.538004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:35.546591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a7a472bb-7434-4d0f-9c81-083c81e2fb10 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.174595 Nov 22 13:44:35.547496 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 71/148] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:35 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:36.007273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e0eb720f-e95e-4238-b331-3c803b1f9bde tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 2.654494 Nov 22 13:44:36.007917 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 78/149] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:33 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:36.563565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:36.564182 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:36.570389 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:36.570853 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:36.571641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:36.572547 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:36.753697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:36.761456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80cae2ed-d05c-4e9f-a009-e61d0cce5b47 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.201480 Nov 22 13:44:36.762168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 72/150] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:36 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:37.027333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:37.028338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:37.036360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:37.036808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:37.037668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:37.038081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:37.778489 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:37.780102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:37.788155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:37.788904 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:37.789914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:37.790743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:37.946399 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:37.954511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-91010aed-7c5b-4787-b081-f2de0a6b384b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.180682 Nov 22 13:44:37.955101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 73/151] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:37 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:38.971279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:38.971912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:38.977647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:38.978647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:38.979431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:38.979872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:39.111944 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:39.120366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3c49b058-1edb-41b1-bb86-30a418b4c1c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.152279 Nov 22 13:44:39.120987 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 74/152] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:38 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:39.942647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-be8ea164-5683-465b-b0ec-fe987430b4bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 2.919236 Nov 22 13:44:39.946027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 79/153] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:37 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 2921 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:40.137308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:40.139033 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:40.145514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:40.145963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:40.146958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:40.147379 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:40.291579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:40.299243 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c3fbe39b-65d4-40bc-b6eb-6043a56d9998 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.165536 Nov 22 13:44:40.299824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 75/154] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:40 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:40.954435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:40.955546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:40.964881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:40.965687 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:40.966149 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:40.966638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.070833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1278da44-2187-41e7-b95b-ebc522cf9e10 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.120687 Nov 22 13:44:41.074656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 80/155] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:40 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:41.322295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:41.322997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:41.330272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.331254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.332447 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.335337 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.458802 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:41.459353 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:41.474674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.475345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.476299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.476885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.524593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:44:41.597820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:41.607092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-37a700f4-2b0d-4573-bcdb-ca47e46338d6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.293597 Nov 22 13:44:41.607725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 76/156] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:41 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:41.641408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-37298867-5811-4eee-99a5-99380d4660c9 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 204 len: 0 microversion: 2.1 time: 0.186191 Nov 22 13:44:41.642606 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 81/157] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:44:41 2021] DELETE /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 13:44:41.651652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:41.652365 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:41.658252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.658700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.659484 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:41.659915 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:41.805723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:41.813835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-082a0a87-dd28-4da8-985e-02ee8591317a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1554 microversion: 2.1 time: 0.166872 Nov 22 13:44:41.814645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 77/158] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:41 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:42.082720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:42.083639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:42.091236 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.091683 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.092458 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.092892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.167277 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-35789f26-0593-4f09-91b3-b0d9f72a9598 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.088562 Nov 22 13:44:42.168121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 82/159] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:42 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:42.623706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:42.624406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:42.630970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.631470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.632430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.633416 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.792695 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:42.800627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-556065d7-5244-446f-9f4b-4c72bf830c9b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.180581 Nov 22 13:44:42.801220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 78/160] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:42 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:42.832088 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:42.833338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:42.844029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.844864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.846099 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:42.846805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:42.988824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:42.997432 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-99a735ce-0207-4854-a897-951a6a541012 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1554 microversion: 2.1 time: 0.169289 Nov 22 13:44:42.998011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 83/161] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:42 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:43.179486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:43.180563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:43.188492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:43.189018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:43.189992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:43.190441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:43.289644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8fb17f47-0796-4b9d-b4de-bdcdcc876f05 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.113685 Nov 22 13:44:43.290949 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 79/162] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:43 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:43.817421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:43.818069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:43.824416 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:43.824872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:43.825684 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:43.826121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:43.979505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:43.986560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-affc2f4c-13b7-4dac-8918-1edf69d3dda6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.172694 Nov 22 13:44:43.987440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 84/163] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:43 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:44.018702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:44.019415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:44.026540 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:44.027001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:44.027860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:44.028309 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:44.191859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:44.200066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4051c725-b40f-475c-9706-8d163e8ff658 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1554 microversion: 2.1 time: 0.185388 Nov 22 13:44:44.200865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 80/164] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:44 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:44.302800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:44.303779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:44.315390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:44.315925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:44.316967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:44.318029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:44.397063 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f67770ef-b4f9-46f1-aaba-6b9f10165911 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 14 microversion: 2.1 time: 0.099441 Nov 22 13:44:44.398025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 85/165] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:44 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:44:44.835308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-274a276e-2f85-412f-814c-f0ba9d2f2285 req-2b0ecab1-02e2-4cc1-b0a5-247681f307c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2fe9ac-97f3-4fc6-b22b-40815195b764", "name": "network-vif-deleted", "tag": "e44bb438-71ff-4eeb-a5ea-30e885ca07a2"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:44.836800 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:44.836800 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:44.846485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-274a276e-2f85-412f-814c-f0ba9d2f2285 req-2b0ecab1-02e2-4cc1-b0a5-247681f307c3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:44.846910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-274a276e-2f85-412f-814c-f0ba9d2f2285 req-2b0ecab1-02e2-4cc1-b0a5-247681f307c3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:44.856956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-274a276e-2f85-412f-814c-f0ba9d2f2285 req-2b0ecab1-02e2-4cc1-b0a5-247681f307c3 service nova] Creating event network-vif-deleted:e44bb438-71ff-4eeb-a5ea-30e885ca07a2 for instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 on hv-cinder-76845 Nov 22 13:44:44.861668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-274a276e-2f85-412f-814c-f0ba9d2f2285 req-2b0ecab1-02e2-4cc1-b0a5-247681f307c3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030073 Nov 22 13:44:44.862256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 81/166] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:45.006023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:45.006721 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:45.014603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.015049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:45.015830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.016261 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:45.163167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:45.175361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-83d10b6b-51e2-4c2d-a73f-f90f750152fc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.172778 Nov 22 13:44:45.185036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 86/167] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:45 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:45.218704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:45.220016 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:45.226532 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.226990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:45.228599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.229118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:45.344411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:45.378486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cd3ab9e9-a954-4686-b341-633f88e01d2e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1512 microversion: 2.1 time: 0.163943 Nov 22 13:44:45.379559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 82/168] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:45 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:45.408901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:45.409881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:45.416889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.417382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:45.418176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:45.418617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:46.193615 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:46.194269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:46.201387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:46.201846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:46.202837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:46.203284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:46.353743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:46.363926 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7dbb9715-f192-4658-85ba-0b22c361c27c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.175829 Nov 22 13:44:46.364510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 83/169] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:46 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:46.395668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:46.396317 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:46.403457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:46.403917 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:46.404712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:46.405161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:46.473546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:46.482935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-493608f3-230c-487e-91f3-963e36f2a22e tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1512 microversion: 2.1 time: 0.090845 Nov 22 13:44:46.483780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 84/170] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:46 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:47.381714 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:47.382327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:47.391005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:47.403319 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:47.413968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:47.414716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:47.881959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e64dafee-3141-4820-a4d1-7246e9943d07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 6321 microversion: 2.1 time: 2.477428 Nov 22 13:44:47.886916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 87/171] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:45 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 6321 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:47.894627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:47.896289 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:47.905942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:47.906503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:47.907417 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:47.908055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:47.995456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:48.004768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9f87e5be-9aba-4738-aa6e-8d58ff3972b0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.627120 Nov 22 13:44:48.005387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 85/172] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:47 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:48.020293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:48.029178 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2a645967-9b57-4955-96c8-378ce0b00a2b tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1346 microversion: 2.1 time: 0.140718 Nov 22 13:44:48.029869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 88/173] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:47 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:48.895212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:48.897481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:48.919690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:48.920157 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:48.920981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:48.925571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.027354 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:49.027977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:49.045307 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:49.045888 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.047116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:49.047710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.060332 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b837a8a3-bc0e-4093-9bf2-71c88d3d2560 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 8268 microversion: 2.1 time: 0.169275 Nov 22 13:44:49.064604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 86/174] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:48 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 8268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:49.074185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:49.079003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:49.107269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:49.107770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.109829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:49.111505 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.245408 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:49.245865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:49.246319 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lazy-loading 'fault' on Instance uuid ff2fe9ac-97f3-4fc6-b22b-40815195b764 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:44:49.372309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:49.381771 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d1699797-2938-4757-9ffd-ae3444f83f8e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.363190 Nov 22 13:44:49.391908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 89/175] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:49 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:49.394063 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a688b00f7a4b3b896e313207e71e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d37c16844146be90e42574973a6861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:49.405826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ee675e45-415b-4593-8f30-728004c7f96f tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 200 len: 1351 microversion: 2.1 time: 0.339674 Nov 22 13:44:49.406435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 87/176] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:49 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 1351 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:50.071924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:50.073483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:50.081191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.081872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.082947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.083392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.178353 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-585a648c-d407-4f11-9825-59c8fb8f28ae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 13175 microversion: 2.1 time: 0.110547 Nov 22 13:44:50.183621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 90/177] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:50 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 13175 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:50.341528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1175005173", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "a84a04f9-b201-43c0-84cd-ce6ec22f409e"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:50.403760 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:50.404495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:50.426000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.426549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.427935 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.428853 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.447207 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] validate_networks() for [('a84a04f9-b201-43c0-84cd-ce6ec22f409e', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:44:50.720417 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:50.733367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bccbbafe-4514-4429-9836-19827b619822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.337017 Nov 22 13:44:50.734278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 91/178] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:50 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:50.741315 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:50.741886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:50.748284 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.748734 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.749747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.750618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.770266 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] HTTP exception thrown: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. Nov 22 13:44:50.770947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Returning 404 to user: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:44:50.771773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-db1e0c78-e680-47bc-a5a2-4f4f66f5c535 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 404 len: 111 microversion: 2.1 time: 0.036572 Nov 22 13:44:50.772493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 92/179] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:50 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:44:50.957824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:50.958751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:50.968812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.969277 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.971533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:50.972131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:50.997116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] HTTP exception thrown: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. Nov 22 13:44:50.998246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Returning 404 to user: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:44:50.999259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3afc744c-50e3-4b9c-b17e-cb2a792b1954 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045402 Nov 22 13:44:51.000386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 93/180] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:44:50 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 13:44:51.165657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:44:51.166254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:44:51.166983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:44:51.167407 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:44:51.167923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:44:51.177548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.178116 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.179068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.179513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.193011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:51.194227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:51.207274 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.207912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.208647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:44:51.209144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.209611 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.214075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for user bcfdb2c09693488588c0a7b1232739e0 and project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:44:51.229510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:44:51.231866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:44:51.284621 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a37c17c0-e759-449d-a644-ac4b4d9e60ee tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946651 Nov 22 13:44:51.285958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 88/181] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:44:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:44:51.297047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5aa22d00-ba4e-498c-bff7-f7d3d4e78280 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:51.299669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5aa22d00-ba4e-498c-bff7-f7d3d4e78280 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:51.326172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-90083e49-5c0a-4051-9c43-bff80554d5bf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 16163 microversion: 2.1 time: 0.139348 Nov 22 13:44:51.327294 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 94/182] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:51 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 16163 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:44:51.364368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5aa22d00-ba4e-498c-bff7-f7d3d4e78280 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:51.374398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5aa22d00-ba4e-498c-bff7-f7d3d4e78280 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1218 microversion: 2.1 time: 0.080838 Nov 22 13:44:51.375663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 89/183] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:51 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:51.753700 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:51.764312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:51.773192 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.774133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.775601 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:51.776308 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:51.987199 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:52.001112 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6f17bf73-9070-4d84-b874-f7756f984e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.251939 Nov 22 13:44:52.014103 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 95/184] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:51 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:52.237830 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:52.238643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:52.257934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.258396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.260029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.260562 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.274638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] HTTP exception thrown: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. Nov 22 13:44:52.275241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Returning 404 to user: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:44:52.276069 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-270ce9c3-473a-4452-a168-39fc7876dd06 tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 404 len: 111 microversion: 2.1 time: 0.042806 Nov 22 13:44:52.276811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 90/185] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:44:52 2021] DELETE /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:44:52.284807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:52.286224 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] [instance: ff2fe9ac-97f3-4fc6-b22b-40815195b764] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:52.294160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.294693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.295585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.296096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.310750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] HTTP exception thrown: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. Nov 22 13:44:52.311448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] Returning 404 to user: Instance ff2fe9ac-97f3-4fc6-b22b-40815195b764 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:44:52.312341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-747c6107-3f9e-4488-8eca-a93daeda891a tempest-DeleteServersTestJSON-437769896 tempest-DeleteServersTestJSON-437769896-project] 10.222.0.31 "GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764" status: 404 len: 111 microversion: 2.1 time: 0.031186 Nov 22 13:44:52.313527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 96/186] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:52 2021] GET /compute/v2.1/servers/ff2fe9ac-97f3-4fc6-b22b-40815195b764 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:44:52.337883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:52.338867 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:52.344878 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.345673 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.346535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.347229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.395351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:52.396070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:52.403113 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.403958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.404993 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:52.405618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:52.436594 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-06ba4ce1-59e7-47b5-ba0d-b0f1e7002efd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 17861 microversion: 2.1 time: 0.102602 Nov 22 13:44:52.439145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 91/187] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:52 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 17861 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:52.534528 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:52.545035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fdb5b9fd-a56a-4c46-88b7-0fb04dd6a9a7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1270 microversion: 2.1 time: 0.154743 Nov 22 13:44:52.546577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 97/188] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:52 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:53.020680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:53.023817 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:53.048324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.049088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.050934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.051686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.459915 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:53.465366 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:53.475077 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.478503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.494017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.495345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.605126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9ee48ea4-c5ee-4129-857b-e031b0ba89c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 18663 microversion: 2.1 time: 0.159057 Nov 22 13:44:53.616628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 98/189] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:53 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 18663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:53.622511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:53.623791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:53.634558 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.635416 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.637272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:53.638044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:53.841873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:53.856062 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2057d31b-d772-47aa-8440-fe6a7a88c889 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1276 microversion: 2.1 time: 0.237755 Nov 22 13:44:53.858773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 99/190] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:53 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:54.097595 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:54.106029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a33a3d77-f461-4aad-b821-a6b3ba254af2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 1.089858 Nov 22 13:44:54.106624 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 92/191] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:53 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:54.621489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:54.622416 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:54.649877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:54.650350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:54.651162 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:54.658038 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:54.792991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0951e5fc-7412-474f-aa28-273bcae6ce19 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 20997 microversion: 2.1 time: 0.175942 Nov 22 13:44:54.797640 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 100/192] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:54 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 20997 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:54.881899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:54.882873 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:54.898654 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:54.901772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:54.904217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:54.904905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:55.123811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:55.124791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:55.140325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:55.145696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:55.154755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:55.155772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:55.165807 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:55.191433 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-65beac41-a093-4303-99b5-6fb366b2abb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1276 microversion: 2.1 time: 0.318294 Nov 22 13:44:55.193826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 93/193] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:54 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:55.515542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:55.523057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f329133c-87d1-4d8d-985a-a174edae7b3f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.403192 Nov 22 13:44:55.523527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 101/194] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:55 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:55.806287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:55.807617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:55.827309 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:55.830066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:55.838525 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:55.841260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:55.959176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-185eff00-540f-406c-b596-83ce6aa515cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 22724 microversion: 2.1 time: 0.157493 Nov 22 13:44:55.960719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 94/195] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:55 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 22724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:56.182931 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-21d81e6a-b020-4247-af22-bafcdd66f732 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Action: 'create', calling method: .version_select at 0x7f673e770040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1067209242", "metadata": {"Type": "work"}}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:56.212048 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:56.212835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:56.225860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:56.230820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:56.232120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:56.232849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:56.741310 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:56.754967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ba358329-498d-454a-91d5-1ed913c4d2a6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.547299 Nov 22 13:44:56.755632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 95/196] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:56 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:56.789214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:56.796020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:56.812069 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:56.813981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:56.817071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:56.825441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:56.895197 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-21d81e6a-b020-4247-af22-bafcdd66f732 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.047021 Nov 22 13:44:56.903639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 102/197] 10.222.0.31 () {60 vars in 1155 bytes} [Mon Nov 22 13:44:55 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1050 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 22 13:44:56.909494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-67b35da5-335b-450e-a2af-9a4683440155 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e5bf8b0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:57.137817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-67b35da5-335b-450e-a2af-9a4683440155 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 353 microversion: 2.1 time: 0.231081 Nov 22 13:44:57.137817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 103/198] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:44:56 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:57.142582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:57.143506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:57.168327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:57.168808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:57.169673 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:57.176256 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:57.341243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-96156ae5-50b9-489d-9856-ce60339a2b68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 23809 microversion: 2.1 time: 0.202778 Nov 22 13:44:57.341947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 104/199] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:57 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 23809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:44:57.682628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:57.700956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c7615116-7c2b-4170-9eeb-5d2d13014b3c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.933121 Nov 22 13:44:57.702058 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 96/200] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:56 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:57.775429 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:57.777088 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:57.797481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:57.799365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:57.800892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:57.802871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:57.900663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-9ee12528-b958-44e5-a001-67779011068d req-e9b34c29-3db1-4ea2-8b0d-edaff0075e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2ef5de-febe-4a82-a6e4-39273ff76912", "tag": "80f03947-781b-4a39-9323-dfa2732c6802"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:57.903435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:44:57.903435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:44:57.922378 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-9ee12528-b958-44e5-a001-67779011068d req-e9b34c29-3db1-4ea2-8b0d-edaff0075e57 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:57.922841 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-9ee12528-b958-44e5-a001-67779011068d req-e9b34c29-3db1-4ea2-8b0d-edaff0075e57 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:57.942316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-9ee12528-b958-44e5-a001-67779011068d req-e9b34c29-3db1-4ea2-8b0d-edaff0075e57 service nova] Creating event network-changed:80f03947-781b-4a39-9323-dfa2732c6802 for instance ec2ef5de-febe-4a82-a6e4-39273ff76912 on hv-cinder-76845 Nov 22 13:44:57.956552 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-9ee12528-b958-44e5-a001-67779011068d req-e9b34c29-3db1-4ea2-8b0d-edaff0075e57 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060195 Nov 22 13:44:57.960909 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 97/201] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:44:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:44:58.148795 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1e0ce895-32a5-4d43-81cc-0f65eee451fe tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673deafd30>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:58.221565 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:58.234897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-35434c00-0f69-4fac-94ab-93f4c85b40ab tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.465100 Nov 22 13:44:58.237389 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 105/202] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:57 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:44:58.251071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1e0ce895-32a5-4d43-81cc-0f65eee451fe tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 354 microversion: 2.1 time: 0.106834 Nov 22 13:44:58.251633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 98/203] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:44:58 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:44:58.267001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-22f16bf3-b7f1-4a2d-b642-32178f16ee97 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e6408b0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:58.356518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:44:58.357747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:58.371106 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:58.373835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:58.376454 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-22f16bf3-b7f1-4a2d-b642-32178f16ee97 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 354 microversion: 2.1 time: 0.116106 Nov 22 13:44:58.377439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 106/204] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:44:58 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:58.385352 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:58.396512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3f627c0f-d13d-4e33-8cb9-e809704f25b4 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e66bca0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:58.400187 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:58.516167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3f627c0f-d13d-4e33-8cb9-e809704f25b4 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 202 len: 0 microversion: 2.1 time: 0.125827 Nov 22 13:44:58.516711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 107/205] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:44:58 2021] DELETE /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:44:58.526872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ca11bfc-6314-479e-94a8-c7224f0e78b1 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e6393a0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:58.619463 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2ca11bfc-6314-479e-94a8-c7224f0e78b1 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 353 microversion: 2.1 time: 0.097842 Nov 22 13:44:58.620644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 108/206] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:44:58 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:44:58.718530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:58.719367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:58.725870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:58.726493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:58.727475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:58.727910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:59.071697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:59.081458 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c9e2c632-8234-44b1-bed2-61f4d200ff85 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.366910 Nov 22 13:44:59.085343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 109/207] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:58 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:59.252896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:59.253835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:44:59.262427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:59.262882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:59.263689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:44:59.264133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:44:59.669538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:44:59.676815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-eabc8da5-9a00-4696-a7d5-0e3a1a82a933 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.427446 Nov 22 13:44:59.677423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 110/208] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:44:59 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:44:59.693992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-29b4d1f3-a8c6-4eb7-ba62-ff0ceae5c441 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e73d4c0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:44:59.762096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-29b4d1f3-a8c6-4eb7-ba62-ff0ceae5c441 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 353 microversion: 2.1 time: 0.071459 Nov 22 13:44:59.762789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 111/209] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:44:59 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:00.169275 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Action: 'create', calling method: .version_select at 0x7f673e5b1c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1445698613"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:00.192000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for project accea9af00354befabcdcf4325a007ca. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:00.196220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for user 526b9ef5f3674c13b98a9ce5e30923f4 and project accea9af00354befabcdcf4325a007ca. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:00.387469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for project accea9af00354befabcdcf4325a007ca. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:00.391294 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for user 526b9ef5f3674c13b98a9ce5e30923f4 and project accea9af00354befabcdcf4325a007ca. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:00.406102 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-157c2528-7164-489f-8454-6b6f802dab32 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.447984 Nov 22 13:45:00.411352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 112/210] 10.222.0.31 () {60 vars in 1157 bytes} [Mon Nov 22 13:44:59 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:00.412016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:00.412642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:00.428045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:00.429485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:00.431186 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:00.431736 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:00.613532 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bd1765f0-f83d-4231-9619-32d855080e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 27305 microversion: 2.1 time: 2.263141 Nov 22 13:45:00.615036 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 99/211] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:44:58 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 27305 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:45:00.678687 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:00.692619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-06e0b3af-db5d-4a6e-814d-9c44986acca8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.284346 Nov 22 13:45:00.693689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 113/212] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:00 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:00.695562 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:00.696475 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:00.703943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:00.704832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:00.705797 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:00.706376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:00.776011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-023945da-fcdc-41b8-8659-39b0d28acdc1 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e5bf700>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:00.855985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-023945da-fcdc-41b8-8659-39b0d28acdc1 tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 200 len: 353 microversion: 2.1 time: 0.084347 Nov 22 13:45:00.856711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 114/213] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:45:00 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:01.009395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:01.022965 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-681e5723-90aa-494e-847d-a72971fd19bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.331388 Nov 22 13:45:01.034567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 100/214] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:00 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:01.626220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:01.627052 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:01.653630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:01.654125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:01.654941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:01.655384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:01.711186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:01.712373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:01.722390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:01.723004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:01.723888 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:01.724450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:01.935697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-19e0be5d-6a4f-489e-981b-b700ffea0472 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 27605 microversion: 2.1 time: 0.313509 Nov 22 13:45:01.936838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 115/215] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:01 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 27605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:01.941830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f1b7a40a-a34f-4da6-beca-9d5167dee66b tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Calling method '.version_select at 0x7f673e6823a0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:02.101119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-f1b7a40a-a34f-4da6-beca-9d5167dee66b tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] HTTP exception thrown: Volume d5b56429-1030-48c0-a703-e7e896ed98b2 could not be found. Nov 22 13:45:02.104020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f1b7a40a-a34f-4da6-beca-9d5167dee66b tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] Returning 404 to user: Volume d5b56429-1030-48c0-a703-e7e896ed98b2 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:45:02.104172 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:02.106232 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f1b7a40a-a34f-4da6-beca-9d5167dee66b tempest-VolumesGetTestJSON-1612321506 tempest-VolumesGetTestJSON-1612321506-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2" status: 404 len: 109 microversion: 2.1 time: 0.166811 Nov 22 13:45:02.108256 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 116/216] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:45:01 2021] GET /compute/v2.1/os-volumes/d5b56429-1030-48c0-a703-e7e896ed98b2 => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:45:02.122672 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b0204dde-ac71-473b-b7c3-5415340abfb6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.415590 Nov 22 13:45:02.123282 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 101/217] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:01 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:02.125162 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:02.126066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:02.142500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:02.143221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:02.144848 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:02.145530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:02.460645 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:02.471408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cf8b2155-f283-40bf-aaf3-bfef6459e0d2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.362073 Nov 22 13:45:02.471999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 117/218] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:02 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:02.950594 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:02.952920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:02.960085 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:02.960849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:02.962394 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:02.962955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:03.090632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-50e8b02f-d96c-484f-a6f9-1072ddae671b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 27822 microversion: 2.1 time: 0.145808 Nov 22 13:45:03.094356 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 102/219] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:02 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 27822 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:03.151200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:03.151896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:03.175292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:03.176782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:03.177786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:03.178990 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:03.365429 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:03.384702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e9791c22-ee67-484f-b8e5-96acf9289f17 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.231280 Nov 22 13:45:03.390414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 118/220] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:03 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:03.490214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:03.491208 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:03.506944 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:03.513963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:03.515053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:03.520620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:03.807770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:03.816791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a89c8cc7-555b-4faa-916e-2a8b6118580e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.330752 Nov 22 13:45:03.827411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 103/221] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:03 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:04.102959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:04.104077 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:04.111003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.111729 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:04.112532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.113016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:04.219765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bbfc8ce9-9964-40bf-b4f2-0e81f1d75ca0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28197 microversion: 2.1 time: 0.121095 Nov 22 13:45:04.220654 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 119/222] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:04 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:04.404540 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:04.405183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:04.412466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.412951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:04.413769 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.414203 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:04.561260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:04.579192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d352f5f8-ba00-4da5-b817-cf907fd3b342 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.178744 Nov 22 13:45:04.589324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 104/223] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:04 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:04.834166 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:04.834973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:04.843744 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.844203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:04.844995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:04.846751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:05.071101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:05.085387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4280131b-7826-492b-b3d4-e854efe303a9 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.250624 Nov 22 13:45:05.085387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 120/224] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:04 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:05.233591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:05.238286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:05.242257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:05.243444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:05.244418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:05.244881 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:05.320849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fc4ccb2a-c2db-4768-b586-671094f15f68 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28197 microversion: 2.1 time: 0.091606 Nov 22 13:45:05.325277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 105/225] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:05 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:05.597009 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:05.597738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:05.605524 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:05.605980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:05.606770 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:05.607209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:05.757228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:05.764906 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2ca229ad-c30c-4600-a3ef-bc25512ab3a9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.171448 Nov 22 13:45:05.775969 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 121/226] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:05 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:06.103286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:06.104216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:06.113776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.114469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.115367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.116113 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.304396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:06.321955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-36cd84e0-579e-4ae5-bc94-5d3a315f4c11 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.223372 Nov 22 13:45:06.322731 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 106/227] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:06 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:06.338310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:06.340950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:06.359944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.360862 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.362314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.362766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.459318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-61afe5f2-a0d9-4044-a643-b0f547bfd45b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28197 microversion: 2.1 time: 0.129020 Nov 22 13:45:06.461126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 122/228] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:06 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:06.743457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-ffe74d16-0a62-4e17-b23b-6270279f3006 req-b7b5bd27-18e1-4d97-9ad3-47c28828b01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2ef5de-febe-4a82-a6e4-39273ff76912", "name": "network-vif-plugged", "status": "completed", "tag": "80f03947-781b-4a39-9323-dfa2732c6802"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:06.745418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:06.745418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:45:06.756068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-ffe74d16-0a62-4e17-b23b-6270279f3006 req-b7b5bd27-18e1-4d97-9ad3-47c28828b01d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.756596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-ffe74d16-0a62-4e17-b23b-6270279f3006 req-b7b5bd27-18e1-4d97-9ad3-47c28828b01d service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.768836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-ffe74d16-0a62-4e17-b23b-6270279f3006 req-b7b5bd27-18e1-4d97-9ad3-47c28828b01d service nova] Creating event network-vif-plugged:80f03947-781b-4a39-9323-dfa2732c6802 for instance ec2ef5de-febe-4a82-a6e4-39273ff76912 on hv-cinder-76845 Nov 22 13:45:06.774952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-ffe74d16-0a62-4e17-b23b-6270279f3006 req-b7b5bd27-18e1-4d97-9ad3-47c28828b01d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Nov 22 13:45:06.775755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 107/229] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:06.797471 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:06.800972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:06.813744 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.814247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.815060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:06.815511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:06.989404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:06.999761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5f65e60e-e60f-419e-a20c-9d2782072822 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.219701 Nov 22 13:45:07.000880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 123/230] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:06 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:07.339955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:07.342714 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:07.349043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:07.349726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:07.350828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:07.351341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:07.472129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:07.473128 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:07.480119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:07.480855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:07.481907 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:07.483199 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:07.565900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:07.576063 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-69c6ac67-36aa-46d0-ab68-e206edd1cf20 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1318 microversion: 2.1 time: 0.240328 Nov 22 13:45:07.583231 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9d8879e1-654a-4ec8-b2e3-137655fe7705 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28197 microversion: 2.1 time: 0.115112 Nov 22 13:45:07.584341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 124/231] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:07 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:07.589668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 108/232] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:07 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:08.018790 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:08.019495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:08.026473 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.026936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.027731 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.028177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.179670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:08.187598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0da82f0e-e918-4531-9468-e8125a36d9b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.172791 Nov 22 13:45:08.188170 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 125/233] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:08 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:08.598752 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:08.600410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:08.606462 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:08.607382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:08.614257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.614957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.616068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.616180 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.616531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.616639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.617944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.618613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.721909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f58a81f5-2547-4f40-ac53-ea8bb4797ade tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28399 microversion: 2.1 time: 0.118844 Nov 22 13:45:08.723237 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 126/234] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:08 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28399 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:08.774656 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:08.783629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5d12dca1-7806-4018-9a8d-000181fdce96 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1508 microversion: 2.1 time: 0.189945 Nov 22 13:45:08.784588 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 109/235] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:08 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:08.807108 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cef03ad-c09f-4ee1-ad08-0af42c932ea8"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:08.809127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:08.817924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.818626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.819477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.819918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.902742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Invalid volume: volume 6cef03ad-c09f-4ee1-ad08-0af42c932ea8 is already attached to instances: fc23c4cb-5e26-4a3f-83a2-3f73820458a7 Nov 22 13:45:08.903613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 400 to user: Invalid volume: volume 6cef03ad-c09f-4ee1-ad08-0af42c932ea8 is already attached to instances: fc23c4cb-5e26-4a3f-83a2-3f73820458a7 {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:45:08.904716 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b872f8a5-08e0-4eef-a571-93d7bb33500a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105279 Nov 22 13:45:08.905485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 127/236] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:45:08 2021] POST /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 13:45:08.968660 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:08.969159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:08.975410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.975856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:08.977411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:08.978027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.136276 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'services' on Instance uuid fc23c4cb-5e26-4a3f-83a2-3f73820458a7 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:45:09.210057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:09.212053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:09.220333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.220720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.221541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.222143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.314195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-198f343c-e298-476c-a1a6-709e20e2c3d7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments/6cef03ad-c09f-4ee1-ad08-0af42c932ea8" status: 202 len: 0 microversion: 2.1 time: 0.347279 Nov 22 13:45:09.318399 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 110/237] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:45:08 2021] DELETE /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments/6cef03ad-c09f-4ee1-ad08-0af42c932ea8 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:45:09.349073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:09.352261 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:09.371528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.372156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.376986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.377515 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.432702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1958634a-7ecb-415c-a94a-6f2a9f60e597 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113070 Nov 22 13:45:09.433367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 111/238] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:09 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:09.440215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:09.467397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-12e7f3ad-a9b9-43e5-91ba-3d0d6071471a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.266364 Nov 22 13:45:09.472011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 128/239] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:09 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:09.734107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:09.735126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:09.741900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.743232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.744916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:09.745470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:09.843110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1698e5ab-83bd-4bcf-a8dc-77c7cf5354a1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28475 microversion: 2.1 time: 0.112809 Nov 22 13:45:09.843762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 112/240] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:09 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28475 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:10.443858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:10.444846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:10.451807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.452263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.453051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.453506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.484991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-db517338-4c5d-41c3-8f17-c2113facb70e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Nov 22 13:45:10.486122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 129/241] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:10 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:10.493845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:10.494544 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:10.502585 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.503041 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.504099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.504537 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.707473 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:10.730460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3135a4b7-1e11-49a1-8445-5e190ac47eeb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.240618 Nov 22 13:45:10.731438 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 113/242] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:10 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:10.856982 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:10.857993 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:10.865084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.865580 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.866379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:10.866820 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:10.971728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6552ef94-2c61-43da-b8cc-342450e961f9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28643 microversion: 2.1 time: 0.120184 Nov 22 13:45:10.973229 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 130/243] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:10 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28643 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:11.498456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:11.499380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:11.505781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.506231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:11.507009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.507442 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:11.544928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d3132d00-4e9d-4fdc-96db-4be508d508bd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051508 Nov 22 13:45:11.545901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 114/244] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:11 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:11.748702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:11.749776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:11.756990 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.757466 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:11.758995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.759433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:11.917615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:11.924979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b6bebfe7-60c0-43c7-abeb-4a1e7773ff89 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.180232 Nov 22 13:45:11.925564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 131/245] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:11 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:11.985934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:11.986857 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:11.993900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.994380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:11.995165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:11.995596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:12.078725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0b3fbdf7-580e-4f76-b5c6-4cfe1fad1f83 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28643 microversion: 2.1 time: 0.098546 Nov 22 13:45:12.079480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 115/246] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:11 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:12.557030 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:12.558093 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:12.564604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:12.564871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:12.565869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:12.566474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:12.611991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7a58ece9-ab62-4deb-8989-0dd36359853b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059226 Nov 22 13:45:12.612667 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 132/247] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:12 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:12.942298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:12.942994 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:12.950598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:12.950987 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:12.953173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:12.953173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:13.112869 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:13.120884 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4fd6d3cb-4531-4596-997b-031fa874eaf6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.182430 Nov 22 13:45:13.131820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 116/248] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:12 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:13.135680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:13.136714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:13.143933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:13.144394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:13.145192 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:13.145663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:13.238940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7a992c89-f784-48ed-ab3f-a069390cefa1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28643 microversion: 2.1 time: 0.112512 Nov 22 13:45:13.239834 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 133/249] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:13 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28643 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:13.623558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:13.624464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:13.630702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:13.631145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:13.631909 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:13.632339 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:13.664882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a61d3038-e831-47dd-a36e-586d5fa6e987 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Nov 22 13:45:13.665477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 117/250] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:13 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:14.139102 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:14.139799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:14.146609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.147058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.147833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.148335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.251082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:14.252178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:14.260287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.260287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.260287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.267397 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.289974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:14.297638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fbab21ae-8fc3-4072-a727-964b796c938e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.162518 Nov 22 13:45:14.298394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 134/251] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:14 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:14.345355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-52616138-9c7b-471c-b329-567d2ec7f736 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28643 microversion: 2.1 time: 0.097857 Nov 22 13:45:14.346249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 118/252] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:14 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28643 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:45:14.675721 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:14.676686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:14.683080 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.683530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.684311 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:14.684749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:14.715987 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b57d07b9-9094-4334-b4f8-7f93f0c3cedb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Nov 22 13:45:14.716566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 135/253] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:14 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:15.315556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:15.316787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:15.323998 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.324454 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.325267 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.327158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.356910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:15.357911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:15.364778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.365613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.366367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.366876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.463743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:15.470914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-72fb645d-8ff4-49a3-a48e-c73d639cf2a6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.159358 Nov 22 13:45:15.471486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 119/254] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:15 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:15.727603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:15.728565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:15.734742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.735193 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.735953 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:15.736385 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:15.765637 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9e291c34-7404-4948-b277-ea43a884395f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Nov 22 13:45:15.766201 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 120/255] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:15 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:16.488301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:16.488934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:16.496034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:16.496493 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:16.497298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:16.497744 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:16.624532 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:16.632115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-958421c6-8d0e-4927-b27f-b87ded44961e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.147466 Nov 22 13:45:16.632668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 121/256] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:16 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:16.777751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:16.778686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:16.784548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:16.784997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:16.785804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:16.786237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:16.816591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f51663db-8ffd-42ba-94eb-3fb61da1e651 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Nov 22 13:45:16.817140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 122/257] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:16 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:17.649522 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:17.650165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:17.656397 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:17.656848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:17.657655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:17.658088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:17.792977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:17.802521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c40348d9-2ad3-4a18-9f80-e3a48d45a7c1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.156337 Nov 22 13:45:17.803503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 123/258] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:17 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:17.828762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:17.829754 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:17.835712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:17.836165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:17.836948 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:17.837465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:17.866496 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e11217a5-ba1d-4958-b52f-4dc6d4cb4cd7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Nov 22 13:45:17.867058 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 124/259] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:17 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:18.334807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9d61a743-2a7e-4aeb-bbf1-8325fa76524b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28643 microversion: 2.1 time: 2.981797 Nov 22 13:45:18.336300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 136/260] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:15 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28643 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:45:18.819577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:18.820111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:18.826813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:18.827258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:18.828021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:18.828456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:18.880756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:18.881940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:18.889987 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:18.890877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:18.892029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:18.892466 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:18.926016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4b0c41c3-7483-4fad-9246-96b986f9396b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050421 Nov 22 13:45:18.926646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 137/261] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:18 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:18.976442 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:18.986523 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2a088309-6ded-4670-b3ee-88bc3dc2ecda tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.170705 Nov 22 13:45:18.987109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 125/262] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:18 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:19.347693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:19.348638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:19.354825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:19.355273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:19.356195 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:19.356468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:19.454976 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8ad8c410-bfc3-498f-a210-cfb40864d8fe tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 28972 microversion: 2.1 time: 0.110695 Nov 22 13:45:19.456067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 138/263] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:19 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 28972 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:19.624778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1924469314", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "369cd7dd-1c9d-49ea-964a-b204a6cb66f8"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:19.938396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:19.939415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:19.946235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:19.947501 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:19.948477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:19.948927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:19.978301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-97d8e709-a275-4d0a-84e2-a14859b77d29 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043726 Nov 22 13:45:19.978761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 139/264] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:45:19 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:45:20.003622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:20.004226 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:20.010986 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:20.011433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:20.012209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:20.012638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:20.150423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:20.157677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-888ce323-0539-4abe-b890-3d7923bbbf38 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.157884 Nov 22 13:45:20.158242 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 140/265] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:19 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:20.162396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-257827221", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "a84a04f9-b201-43c0-84cd-ce6ec22f409e"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:26.617780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] validate_networks() for [('369cd7dd-1c9d-49ea-964a-b204a6cb66f8', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:45:26.623366 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] validate_networks() for [('a84a04f9-b201-43c0-84cd-ce6ec22f409e', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:45:26.984839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:45:26.985312 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:45:26.985781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:45:26.986180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:45:26.986582 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:45:26.995820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:26.996263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:26.997407 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:26.997846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:26.999193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:45:26.999619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:45:27.000089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:45:27.000500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:45:27.000939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:45:27.009863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.010308 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.011154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.011592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.013988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Getting quotas for project 0ef5dbba9eac4d15aec9b4a4e94cc84c. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:27.017837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Getting quotas for user 7b83b4c5360b4784955f51617f76fadb and project 0ef5dbba9eac4d15aec9b4a4e94cc84c. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:27.028457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:45:27.028601 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:27.030778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:45:27.032429 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for user bcfdb2c09693488588c0a7b1232739e0 and project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:27.043477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:45:27.045816 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:45:27.079150 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c848f87d-0510-47a2-81a4-65d92f2ace48 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.458961 Nov 22 13:45:27.079800 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 126/266] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:45:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 7461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:45:27.088578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:27.088920 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-104183b6-c7fd-4c85-b1da-1c1391c1b526 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.929612 Nov 22 13:45:27.089487 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:27.089608 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 141/267] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:45:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 6931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:45:27.094616 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:27.094616 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:27.096630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.097088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.097918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.098361 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.100222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.100676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.101485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:27.103447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:27.265494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:27.273376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3907021c-797c-4e86-bbe7-739420e1a52a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.182784 Nov 22 13:45:27.274343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 142/268] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:27 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:27.278830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7fb4938e-eb2f-4db6-976a-1a63594a3c12 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:27.279669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7fb4938e-eb2f-4db6-976a-1a63594a3c12 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:27.338532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7fb4938e-eb2f-4db6-976a-1a63594a3c12 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:27.345080 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7fb4938e-eb2f-4db6-976a-1a63594a3c12 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1214 microversion: 2.1 time: 0.069715 Nov 22 13:45:27.345694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 143/269] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:27 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:27.350229 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-740b10f5-59ef-483a-a473-0af8e469c569 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:27.351144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-740b10f5-59ef-483a-a473-0af8e469c569 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:27.433360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-740b10f5-59ef-483a-a473-0af8e469c569 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:27.440985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-740b10f5-59ef-483a-a473-0af8e469c569 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1217 microversion: 2.1 time: 0.094277 Nov 22 13:45:27.441661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 144/270] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:27 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:28.290270 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:28.290876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:28.297304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.297757 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.298533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.299025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.428001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:28.435346 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2166be25-1df3-46b2-b520-76a20517f2c6 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.148689 Nov 22 13:45:28.435916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 145/271] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:28 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:28.440563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:28.441186 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:28.447529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.448190 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.449032 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.449521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.510354 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:28.517360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-501a0ba7-3038-4a4d-a36b-bbb496f9685b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1218 microversion: 2.1 time: 0.080482 Nov 22 13:45:28.517923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 146/272] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:28 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:28.522921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:28.523526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:28.529892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.530375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.531161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:28.531602 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:28.588785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:28.595951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-eacfcf1f-26cd-4510-8443-20123651ae32 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1221 microversion: 2.1 time: 0.076376 Nov 22 13:45:28.596508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 147/273] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:28 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:28.723207 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3047d7e9-7b0a-44d1-9198-8b9c0e81f9a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 37834 microversion: 2.1 time: 1.642179 Nov 22 13:45:28.723852 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 127/274] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:27 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 37834 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:29.453114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:29.453890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:29.463741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.464205 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.466420 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.474111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.535901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:29.536633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:29.545252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.545970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.546925 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.547519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.632218 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:29.636396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:29.640272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b11c92b6-a7d7-4a96-81c5-c9a1f071dfe4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.191383 Nov 22 13:45:29.640846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 148/275] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:29 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:29.645273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:29.646110 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:29.647645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-71916bf0-7783-43f0-8ecb-bd0d544d8386 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1266 microversion: 2.1 time: 0.116377 Nov 22 13:45:29.648304 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 128/276] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:29 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:29.655151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.655890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.656673 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.657109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.719657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:29.733055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f638c300-9f3f-4c5b-96e0-f9d069c59953 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1275 microversion: 2.1 time: 0.090940 Nov 22 13:45:29.734297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 149/277] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:29 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:29.743820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:29.744767 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:29.761923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.768700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.769586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:29.779178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:29.890125 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-14bc5502-baa6-48f0-bb0e-43dc1c88a9c7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 38137 microversion: 2.1 time: 0.158396 Nov 22 13:45:29.890842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 129/278] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:29 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 38137 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:30.659779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:30.659779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:30.666439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:30.666874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:30.670764 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.671276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:30.673341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.673787 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:30.678506 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.680288 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:30.684791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.685448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:30.949517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:30.958900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b64f53cc-ec80-44c0-9c35-3063a91e28dc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.303371 Nov 22 13:45:30.970413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 150/279] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:30 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:30.970413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:30.970413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:30.972182 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.972769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:30.973747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:30.974405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.188077 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:31.198841 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-21dabc50-2229-439d-99d0-f4d0b2a8d26e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.537509 Nov 22 13:45:31.202199 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:31.208587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 130/280] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:30 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:31.215681 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:31.215887 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a08c5de1-999f-4602-929a-fd545a91b485 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.254727 Nov 22 13:45:31.217000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 151/281] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:30 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:31.226524 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:31.236279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.236749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.237588 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.238317 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.330550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-91654d2c-675d-4f3e-bfed-4ca1a096d95d req-a43a6e9d-dc97-47a7-8f05-e6ef0eff60fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f49825-783b-4991-9213-98c29527695e", "tag": "a760b18b-7299-4bf4-8bbf-18fad93e8b12"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:31.333970 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:31.333970 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:31.356100 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-91654d2c-675d-4f3e-bfed-4ca1a096d95d req-a43a6e9d-dc97-47a7-8f05-e6ef0eff60fa service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.356299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-91654d2c-675d-4f3e-bfed-4ca1a096d95d req-a43a6e9d-dc97-47a7-8f05-e6ef0eff60fa service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.368626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-91654d2c-675d-4f3e-bfed-4ca1a096d95d req-a43a6e9d-dc97-47a7-8f05-e6ef0eff60fa service nova] Creating event network-changed:a760b18b-7299-4bf4-8bbf-18fad93e8b12 for instance 16f49825-783b-4991-9213-98c29527695e on hv-cinder-76845 Nov 22 13:45:31.373945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-91654d2c-675d-4f3e-bfed-4ca1a096d95d req-a43a6e9d-dc97-47a7-8f05-e6ef0eff60fa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047072 Nov 22 13:45:31.374543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 152/282] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:31.521508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-97d30b05-16d2-412e-9e89-379bfbf4c47c req-f010257a-2bc5-4d50-8694-bba93eb10ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f8ad0-e330-4a6c-a10d-281daae5598e", "tag": "ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:31.522983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:31.522983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:31.530904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-97d30b05-16d2-412e-9e89-379bfbf4c47c req-f010257a-2bc5-4d50-8694-bba93eb10ec3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.531352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-97d30b05-16d2-412e-9e89-379bfbf4c47c req-f010257a-2bc5-4d50-8694-bba93eb10ec3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.541913 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-97d30b05-16d2-412e-9e89-379bfbf4c47c req-f010257a-2bc5-4d50-8694-bba93eb10ec3 service nova] Creating event network-changed:ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4 for instance ef0f8ad0-e330-4a6c-a10d-281daae5598e on hv-cinder-76845 Nov 22 13:45:31.546457 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-97d30b05-16d2-412e-9e89-379bfbf4c47c req-f010257a-2bc5-4d50-8694-bba93eb10ec3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029639 Nov 22 13:45:31.547040 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 153/283] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:31.977000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:31.978003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:31.984574 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.985025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:31.986089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:31.986535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:32.146366 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:32.154803 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-742cf02c-1be6-4307-a29d-ab3705ac8e39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.182153 Nov 22 13:45:32.155372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 154/284] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:31 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:32.216117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:32.217324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:32.224676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:32.225916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:32.226709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:32.228571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:32.375806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:32.384181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a0233a7a-b07c-4db0-a110-1cdf837fb4c4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.171823 Nov 22 13:45:32.384706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 155/285] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:32 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:32.391109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:32.392291 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:32.399031 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:32.400241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:32.401046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:32.402167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:32.542702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:32.550281 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-82a7fa7f-5c60-4004-97ae-51b473bddec5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.164568 Nov 22 13:45:32.550852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 156/286] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:32 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:33.171706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:33.172310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:33.179082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.179538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.181145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.181464 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.318190 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:33.326428 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1d221882-e010-4bf3-9f5e-88c3d214ad5a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.157528 Nov 22 13:45:33.326428 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 157/287] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:33 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:33.402479 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:33.403117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:33.408897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.409313 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.410088 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.410520 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.543729 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:33.550864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-99d3a0c6-9a20-46b3-9d8d-1138ecfb1a5e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.152699 Nov 22 13:45:33.551419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 158/288] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:33 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:33.566414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:33.567014 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:33.572456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.572902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.574272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:33.574709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:33.704332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:33.712205 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b8beec12-139c-48ec-902a-b28506eb42de tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.149097 Nov 22 13:45:33.713213 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 159/289] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:33 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:34.341901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:34.342526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:34.348612 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.349064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.349876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.350315 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.477668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:34.485746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a3e6c3a9-20a8-4762-a766-3f95f09b10af tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.147723 Nov 22 13:45:34.486314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 160/290] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:34 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:34.566920 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:34.567521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:34.573752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.574210 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.574972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.575401 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.704921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:34.711963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d9798f7b-4829-4975-badb-0582e69cafea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.148745 Nov 22 13:45:34.712520 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 161/291] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:34 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:34.730995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:34.731590 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:34.737050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.737532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.738299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:34.738738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:34.873852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:34.886579 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5f9e2ffb-3fcb-4bab-b690-d52a8d0431fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.159194 Nov 22 13:45:34.887155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 162/292] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:34 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:34.967948 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-292ed8e6-b355-4c77-affe-d1fce4612318 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 38137 microversion: 2.1 time: 3.756998 Nov 22 13:45:34.968702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 131/293] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:31 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 38137 bytes in 3759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:35.502588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:35.503373 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:35.511639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.512130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.512943 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.513712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.730579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:35.731668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:35.738822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.739398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.740350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.740900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.770899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:35.778561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b552d903-8fe5-444a-a94c-77986af4d24b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1521 microversion: 2.1 time: 0.279883 Nov 22 13:45:35.787684 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 163/294] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:35 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:35.895952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:35.903765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:35.904458 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:35.905076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-30b32832-34d6-4ac6-88d6-3923303c2481 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.179365 Nov 22 13:45:35.905692 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 132/295] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:35 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:35.910154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.910602 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.911367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.911799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.980399 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:35.981191 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:35.987176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.987639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:35.988443 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:35.988887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:36.233979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0852bffb-f0ce-4157-a5dc-079ad97e4458 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 38156 microversion: 2.1 time: 0.257829 Nov 22 13:45:36.234666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 133/296] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:35 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 38156 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:36.282369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:36.289936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3c9d34b5-6f6c-4873-ad1c-01328463a2eb tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.390067 Nov 22 13:45:36.290567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 164/297] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:35 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:36.796396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:36.797149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:36.804751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:36.805359 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:36.806081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:36.806516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:36.922325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:36.923125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:36.931524 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:36.932044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:36.932979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:36.933635 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:36.977879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:36.986777 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-00cf0d3e-7590-4dc0-ac88-daaa4a85dc15 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1501 microversion: 2.1 time: 0.195084 Nov 22 13:45:36.999548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 134/298] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:36 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1501 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:37.003001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:37.003886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:37.009716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.010190 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.011024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.011644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.102901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:37.111960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8506b703-2b0d-4bbe-a4b5-bab2759641bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.193051 Nov 22 13:45:37.112551 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 165/299] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:36 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:37.165619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:37.174181 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-00334013-7cf7-4316-844a-762a7ce10089 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1514 microversion: 2.1 time: 0.175024 Nov 22 13:45:37.174756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 135/300] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:36 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:37.250923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:37.252006 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:37.262481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.263247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.264207 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.264786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.310012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:37.310733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:37.320280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.320737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.322122 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.322700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.372785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6054074f-90d6-441c-b9d4-3e080325600f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 200 len: 38268 microversion: 2.1 time: 0.130322 Nov 22 13:45:37.380119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 166/301] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:37 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 38268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:45:37.390490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:37.391107 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:37.398267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.398899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.399849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:37.400434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:37.434629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fc4886d5-d05a-4803-b654-8a9dd946ffcd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/ips" status: 200 len: 145 microversion: 2.1 time: 0.052973 Nov 22 13:45:37.435504 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 167/302] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:45:37 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:37.591237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:37.601857 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-14a545cf-b775-4b52-adfb-7113543f1303 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.297586 Nov 22 13:45:37.602569 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 136/303] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:37 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:38.130499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:38.132505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:38.143015 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.144757 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.146231 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.148352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.217741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1566550143", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445698613", "security_groups": [{"name": "tempest-secgroup-smoke-451825004"}], "block_device_mapping_v2": [{"uuid": "b1a9caba-caf9-4d0e-bccc-2320253ac784", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1613968-954e-4fd7-ab36-ee6aeaa13142"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:38.321956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:38.329468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f29e5863-00c3-4a57-849b-f2be712f366b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.203007 Nov 22 13:45:38.330033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 168/304] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:38 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:38.388292 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] validate_networks() for [('d1613968-954e-4fd7-ab36-ee6aeaa13142', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:45:38.619278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:38.620058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:38.630522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.630977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.631785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.632229 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.806812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:38.814986 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e4f0093a-670e-4798-986b-48fcdc772f61 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.199542 Nov 22 13:45:38.815751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 169/305] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:38 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:38.865675 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:45:38.866030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:45:38.866500 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:45:38.866906 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:45:38.867317 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:45:38.875963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.876413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.877255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:38.877700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:38.894398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:38.898298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for user 526b9ef5f3674c13b98a9ce5e30923f4 and project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:38.956634 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:45:38.958774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1a9caba-caf9-4d0e-bccc-2320253ac784',volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:45:39.098198 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cbb8c031-676e-4f98-9ce2-d6a5f388d808 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.889323 Nov 22 13:45:39.098874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 137/306] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:45:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 13:45:39.108968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f93cc84b-f7fd-4035-9a01-7252b4a069e9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:39.109956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f93cc84b-f7fd-4035-9a01-7252b4a069e9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:39.163909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f93cc84b-f7fd-4035-9a01-7252b4a069e9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:39.170876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f93cc84b-f7fd-4035-9a01-7252b4a069e9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1095 microversion: 2.1 time: 0.065572 Nov 22 13:45:39.171760 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 170/307] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:39 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:39.347233 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:39.347851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:39.354417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:39.354901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:39.355663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:39.356281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:39.503492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:39.511291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7556a3bb-3fa0-4929-b641-f6abcdf27a41 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.168145 Nov 22 13:45:39.512206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 138/308] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:39 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:39.831564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:39.832171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:39.839481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:39.839926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:39.840696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:39.841127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:39.978451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:39.986349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-994e5cf2-17c9-41ca-992e-7f4bd73eb261 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.158467 Nov 22 13:45:39.986902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 171/309] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:39 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:40.188296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:40.188845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:40.194759 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:40.195240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:40.196017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:40.196460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:40.256366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:40.265053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cd037a95-47ea-41ee-9932-cfa5db0673b9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1145 microversion: 2.1 time: 0.080520 Nov 22 13:45:40.265671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 139/310] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:40 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:40.529011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:40.529598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:40.535393 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:40.535845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:40.536620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:40.537055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:40.670124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:40.677287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-db37c48e-5019-421b-b334-2eb841dae741 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.152959 Nov 22 13:45:40.677849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 172/311] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:40 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:41.003566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:41.004179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:41.010762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.011256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:41.012038 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.012477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:41.148509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:41.163957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-44be51af-a27e-4e42-8d29-b1b1c5f84a65 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.164224 Nov 22 13:45:41.164538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 140/312] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:40 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:41.281903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:41.282393 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:41.288571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.289016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:41.289849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.290266 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:41.350388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:41.358741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ea4c5406-7b7e-4c0e-8e3d-4c21cf9abc20 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1193 microversion: 2.1 time: 0.080631 Nov 22 13:45:41.359312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 173/313] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:41 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:41.694915 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:41.695698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:41.714227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.714851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:41.715854 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:41.716288 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.026587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:42.034978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-036ddab4-86eb-44d9-ae02-ee826009d6ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.343606 Nov 22 13:45:42.035572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 141/314] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:41 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:42.185916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:42.191865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:42.199811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.202314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.203912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.204589 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.306216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-978219243", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "74610957-0c8f-4be7-87b5-2b068bd616a7"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:42.364764 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] validate_networks() for [('74610957-0c8f-4be7-87b5-2b068bd616a7', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:45:42.426838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:42.434821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f0b54e7a-82bc-4bfb-b6ef-ff1524c5ccd3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.255836 Nov 22 13:45:42.435384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 174/315] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:42 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:42.448472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:42.449362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:42.455408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.456058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.456843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.457324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.538287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:42.546310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4fbdcd81-3a79-424b-a603-acdba9ddc5bd tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1211 microversion: 2.1 time: 0.109744 Nov 22 13:45:42.547210 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 175/316] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:42 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:42.905333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:42.906320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:42.916738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.917290 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.918034 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:42.921818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:42.966027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'flavor' on Instance uuid 067f06e1-5203-4223-bdb1-f364f84ccaaa {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:45:43.055789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:45:43.058126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:45:43.058825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:45:43.059402 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:45:43.060447 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:45:43.076669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.077856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.079914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.080359 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.111965 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Getting quotas for project 29a21fcc281743ddac3e5b53b5496a61. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:43.119161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Getting quotas for user dc78f8e4f79641d390553bc5e1a954e3 and project 29a21fcc281743ddac3e5b53b5496a61. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:43.129547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-602e93ef-5f15-49f0-a246-6c3af440c810 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action" status: 200 len: 32 microversion: 2.1 time: 0.227229 Nov 22 13:45:43.131096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 176/317] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:42 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:45:43.136678 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:45:43.139651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:45:43.172823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:43.178656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:43.204105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.204936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.206606 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.210007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ab7f3f66-4520-4497-af6a-3b3c6f50723a tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907019 Nov 22 13:45:43.211697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 142/318] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:45:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 13:45:43.221691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.226380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:43.228383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:43.251369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.252017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.258419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.259824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.571901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:43.599926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6298ad61-ee80-4786-ae66-743f9cdae739 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.466031 Nov 22 13:45:43.601745 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 177/319] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:43 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:43.617578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02bd8530-82f4-4caf-a84d-660a90ece6e4"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:43.622012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:43.636591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.637453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.638507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.641424 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.655045 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:43.667158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80d75350-bd0d-46da-ae4d-3b9593fa8b59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.447881 Nov 22 13:45:43.668137 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 143/320] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:43 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:43.677732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d80a25f3-562d-436a-9346-3a7ad5520bc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:43.679747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d80a25f3-562d-436a-9346-3a7ad5520bc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:43.812493 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d80a25f3-562d-436a-9346-3a7ad5520bc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:43.821111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d80a25f3-562d-436a-9346-3a7ad5520bc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1218 microversion: 2.1 time: 0.147237 Nov 22 13:45:43.837984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 144/321] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:43 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:43.847706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:43.848329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:43.869992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.873943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:43.875692 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:43.877372 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.218838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d91141a2-5c43-4481-b924-ed783e16c058 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615339 Nov 22 13:45:44.219761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 178/322] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:45:43 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:44.227791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-1e42d5e4-a21e-4fe8-9209-c620770710a8 req-6c53c4ae-ce95-453c-b5e8-1804a9164299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f8ad0-e330-4a6c-a10d-281daae5598e", "name": "network-vif-plugged", "status": "completed", "tag": "ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:44.238340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:44.238340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:44.265953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-1e42d5e4-a21e-4fe8-9209-c620770710a8 req-6c53c4ae-ce95-453c-b5e8-1804a9164299 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.266464 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-1e42d5e4-a21e-4fe8-9209-c620770710a8 req-6c53c4ae-ce95-453c-b5e8-1804a9164299 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.317350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-1e42d5e4-a21e-4fe8-9209-c620770710a8 req-6c53c4ae-ce95-453c-b5e8-1804a9164299 service nova] Creating event network-vif-plugged:ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4 for instance ef0f8ad0-e330-4a6c-a10d-281daae5598e on hv-cinder-76845 Nov 22 13:45:44.326369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-1e42d5e4-a21e-4fe8-9209-c620770710a8 req-6c53c4ae-ce95-453c-b5e8-1804a9164299 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104457 Nov 22 13:45:44.326980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 179/323] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:44.340817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:44.351537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:44.376044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.377693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.378779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.379278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.419355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:44.433668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-66b17f12-baa5-43f7-b7c8-10916931a811 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.595062 Nov 22 13:45:44.435768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 145/324] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:43 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:44.476337 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-5e9b1318-c27f-4d46-9dfe-f5d0fc7e1c61 req-0a2a1733-a1e0-436f-8e96-613fee32f942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad79f610-9b3d-4c71-a797-2b9ec9602b6c", "tag": "64d8bc36-2015-4ba9-8e04-f54b659d4fa1"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:44.481705 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:44.481705 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:45:44.501334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5e9b1318-c27f-4d46-9dfe-f5d0fc7e1c61 req-0a2a1733-a1e0-436f-8e96-613fee32f942 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.502031 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5e9b1318-c27f-4d46-9dfe-f5d0fc7e1c61 req-0a2a1733-a1e0-436f-8e96-613fee32f942 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.533794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-5e9b1318-c27f-4d46-9dfe-f5d0fc7e1c61 req-0a2a1733-a1e0-436f-8e96-613fee32f942 service nova] Creating event network-changed:64d8bc36-2015-4ba9-8e04-f54b659d4fa1 for instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c on hv-cinder-76845 Nov 22 13:45:44.539497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-5e9b1318-c27f-4d46-9dfe-f5d0fc7e1c61 req-0a2a1733-a1e0-436f-8e96-613fee32f942 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085823 Nov 22 13:45:44.540697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 146/325] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:44.618558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:44.620107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:44.631101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.632048 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.634076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.634802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.736418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:44.743753 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9a6c4d02-c8e5-4340-a065-24e2073f433a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.415359 Nov 22 13:45:44.744327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 180/326] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:44 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:44.749191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:44.749823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:44.755802 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.756257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.757049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.757518 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.811557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:44.819362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b026dd2d-4cd9-4d41-a37d-72287c9cf9e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.205024 Nov 22 13:45:44.820234 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 147/327] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:44 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:44.839902 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:44.840518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:44.846340 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.846787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.847560 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:44.847990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:44.910527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:44.911460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:44.918881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-587ef04b-2edb-4821-832f-eec832d3ce1f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.172954 Nov 22 13:45:44.919440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3a03befa-ed92-47fb-bb42-48bde4def4ea tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1270 microversion: 2.1 time: 0.083298 Nov 22 13:45:44.919570 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 181/328] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:44 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:44.919997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 148/329] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:44 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:45.454879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:45.456192 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:45.464518 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.465390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:45.466629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.467266 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:45.687035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:45.698664 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8d7bc042-5ec2-4bf5-b6ae-4e7ddfe0f268 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.247870 Nov 22 13:45:45.699508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 182/330] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:45 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:45.764922 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:45.766535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:45.775788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.777116 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:45.778117 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.778705 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:45.835665 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:45.836282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:45.843426 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.844161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:45.845106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:45.845710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.058630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:46.066024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d2773771-b68b-4926-87cd-6a6062680272 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1314 microversion: 2.1 time: 0.234173 Nov 22 13:45:46.066583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 183/331] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:45 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:46.070909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:46.071510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:46.077957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.078379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.079168 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.079599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.198746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:46.207950 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dba01371-b220-4952-b06c-b71b4cda3765 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.449129 Nov 22 13:45:46.218666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 149/332] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:45 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:46.223962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:46.225784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:46.226470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:46.233433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2c33d796-dcb8-4adc-956a-c99df23e0be3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.165745 Nov 22 13:45:46.233941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 184/333] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:46 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:46.234078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.234508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.235367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.236017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.345879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-5dc1678b-2173-4891-b318-255547def2db req-1c1750ce-d9e0-49b9-8356-5dfcc3e4c29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f49825-783b-4991-9213-98c29527695e", "name": "network-vif-plugged", "status": "completed", "tag": "a760b18b-7299-4bf4-8bbf-18fad93e8b12"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:46.347455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:46.347455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:46.354957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5dc1678b-2173-4891-b318-255547def2db req-1c1750ce-d9e0-49b9-8356-5dfcc3e4c29b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.355511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5dc1678b-2173-4891-b318-255547def2db req-1c1750ce-d9e0-49b9-8356-5dfcc3e4c29b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.366523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-5dc1678b-2173-4891-b318-255547def2db req-1c1750ce-d9e0-49b9-8356-5dfcc3e4c29b service nova] Creating event network-vif-plugged:a760b18b-7299-4bf4-8bbf-18fad93e8b12 for instance 16f49825-783b-4991-9213-98c29527695e on hv-cinder-76845 Nov 22 13:45:46.372002 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-5dc1678b-2173-4891-b318-255547def2db req-1c1750ce-d9e0-49b9-8356-5dfcc3e4c29b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Nov 22 13:45:46.375515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 185/334] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:46.488509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:46.498809 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e731955a-5c06-4781-a223-fe2a8267edc9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.278540 Nov 22 13:45:46.499731 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 150/335] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:46 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:46.718405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:46.719219 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:46.725154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.725706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.726699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:46.727204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:46.864442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:46.872728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4c850ee2-0f80-404a-b4fa-84fada6990ef tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.159825 Nov 22 13:45:46.873411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 186/336] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:46 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:47.077713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-07c1335f-aab3-49bf-9993-87810a000504 req-670ee9f2-b7c7-4889-9fff-7ff72f3efcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f43fb42-29e7-4162-a4a2-4f4d6f790d7c", "tag": "2d483769-a043-4eb0-92ac-80f96ec6440c"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:47.078749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:47.078749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:45:47.084398 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.085487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.094501 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.095325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.097461 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.098014 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.107218 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-07c1335f-aab3-49bf-9993-87810a000504 req-670ee9f2-b7c7-4889-9fff-7ff72f3efcc5 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.107892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-07c1335f-aab3-49bf-9993-87810a000504 req-670ee9f2-b7c7-4889-9fff-7ff72f3efcc5 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.122229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-07c1335f-aab3-49bf-9993-87810a000504 req-670ee9f2-b7c7-4889-9fff-7ff72f3efcc5 service nova] Creating event network-changed:2d483769-a043-4eb0-92ac-80f96ec6440c for instance 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c on hv-cinder-76845 Nov 22 13:45:47.127635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-07c1335f-aab3-49bf-9993-87810a000504 req-670ee9f2-b7c7-4889-9fff-7ff72f3efcc5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055550 Nov 22 13:45:47.129007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 151/337] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:47.228132 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.229367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.236250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.236900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.238239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.238912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.295910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:47.309058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cacd1c81-7961-4ca8-b3d8-0216efd424b7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1498 microversion: 2.1 time: 0.227894 Nov 22 13:45:47.309752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 187/338] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:47 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:47.314691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.315459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.324353 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.328337 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.328337 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.328337 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.555619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:47.575090 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2a41fe4b-82cd-41ef-9213-fada884153f0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.253978 Nov 22 13:45:47.575966 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 188/339] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:47 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:47.594030 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.595259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.600273 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:47.603413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.604999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.606227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.606853 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.611919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bbccfc81-244a-409d-8209-5bf6bf812ead tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.389534 Nov 22 13:45:47.627581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 152/340] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:47 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:47.786544 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:47.796331 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-22472c06-c3a1-412d-af2c-abbc5538b238 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.217105 Nov 22 13:45:47.796925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 189/341] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:47 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:47.890719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.891354 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.897910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.898366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.899164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.899605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:47.991081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:47.991578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:47.998835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:47.999328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.000522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.001229 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.028752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:45:48.127159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3ab794fa-eabb-4d7e-84b8-37483265c4cb tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 204 len: 0 microversion: 2.1 time: 0.138544 Nov 22 13:45:48.128533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 190/342] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:45:47 2021] DELETE /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:45:48.132966 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:48.137628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:48.138320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:48.142679 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-90d972ed-fcbd-4eee-a2ec-9ea20ff74660 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1317 microversion: 2.1 time: 0.255935 Nov 22 13:45:48.143479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 153/343] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:47 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:48.144332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.144778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.145595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.146027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.321486 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:48.329516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-582ee247-b7f3-401d-ad7e-ea34d3db38e7 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1504 microversion: 2.1 time: 0.196664 Nov 22 13:45:48.330085 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 191/344] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:48 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:48.591813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:48.592423 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:48.598199 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.598649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.599425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.600235 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.630680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:48.631618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:48.637899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.638346 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.639178 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.639740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.764330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:48.773014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-578ff63f-af52-4d63-a785-7d4d9a19cc87 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.185107 Nov 22 13:45:48.773930 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 154/345] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:48 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:48.799391 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:48.808081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9a0b303f-db27-4fa7-a0d4-875f82996432 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.180324 Nov 22 13:45:48.819481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 192/346] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:48 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:48.823305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:48.824366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:48.830588 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.831286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.832043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:48.832477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:48.976668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:48.984546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b5b84b80-fdb8-4e4f-9e4e-b00ad604c07d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.174588 Nov 22 13:45:48.985440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 155/347] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:48 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:49.159697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:49.160846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:49.167934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.168773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.169806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.170468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.345109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:49.346620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:49.347750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:49.352367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d8ca8f5c-958c-469d-94a5-7853ee7844db tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1507 microversion: 2.1 time: 0.196563 Nov 22 13:45:49.352932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 193/348] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:49 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:49.354842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.355907 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.356942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.357614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.535942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:49.544540 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-81e5887f-c062-4f89-9a09-132a88c4375d tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1504 microversion: 2.1 time: 0.201689 Nov 22 13:45:49.545123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 156/349] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:49 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:49.799431 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:49.800049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:49.815675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.816184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.817547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.818234 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.831352 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:49.832521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:49.842134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.843035 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.846321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:49.847291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:49.976132 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:49.984099 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-241a4e76-c054-43b1-b828-ef819b539afa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.190434 Nov 22 13:45:49.985104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 194/350] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:49 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:49.999246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:50.001332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:50.001945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:50.006860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7974bd9e-aec7-4958-91c1-70f55feeba6f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.182188 Nov 22 13:45:50.007429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 157/351] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:49 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:50.008168 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.008626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.009440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.009959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.140786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:50.148822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8651b323-efe3-4e95-86ec-fa04b04399c6 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.150726 Nov 22 13:45:50.149428 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 195/352] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:49 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:50.506444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-25cd1cb2-4dd8-46da-b57f-f2f0c0d5b156 req-cfd3a8d3-09bd-41fd-87b5-99726ce21341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f8ad0-e330-4a6c-a10d-281daae5598e", "name": "network-vif-deleted", "tag": "ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:50.508002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:50.508002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:45:50.515769 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-25cd1cb2-4dd8-46da-b57f-f2f0c0d5b156 req-cfd3a8d3-09bd-41fd-87b5-99726ce21341 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.516211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-25cd1cb2-4dd8-46da-b57f-f2f0c0d5b156 req-cfd3a8d3-09bd-41fd-87b5-99726ce21341 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.527794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-25cd1cb2-4dd8-46da-b57f-f2f0c0d5b156 req-cfd3a8d3-09bd-41fd-87b5-99726ce21341 service nova] Creating event network-vif-deleted:ad2f86b4-6cae-4b9b-ab25-c77f5ab587e4 for instance ef0f8ad0-e330-4a6c-a10d-281daae5598e on hv-cinder-76845 Nov 22 13:45:50.532848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-25cd1cb2-4dd8-46da-b57f-f2f0c0d5b156 req-cfd3a8d3-09bd-41fd-87b5-99726ce21341 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 Nov 22 13:45:50.533454 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 158/353] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:50.561440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:50.562054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:50.567711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.568159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.568931 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.569392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.631278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:50.640842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2a3bd8c3-9c15-4daf-8e7f-c1e6ed226374 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 200 len: 1299 microversion: 2.1 time: 0.083078 Nov 22 13:45:50.641681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 196/354] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:50 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:50.789299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1f9b6fc-43d2-4116-965c-3110b2d57e0d"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:50.790422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:50.796834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.797316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:50.798097 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:50.798519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.002396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:51.004025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:51.011732 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.012813 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.013922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.014359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.067144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4f41eb2f-c8e0-40f4-ab6d-437eb9b75f22 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281873 Nov 22 13:45:51.068960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 159/355] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:45:50 2021] POST /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:51.075054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:51.076177 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:51.084702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.085577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.086686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.087446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.192126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:51.210420 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3f67630c-cc17-414f-ab3a-528c8386f882 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.211691 Nov 22 13:45:51.216469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 197/356] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:50 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:51.232444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:51.234295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:51.246544 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.247289 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.248934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.249546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.316803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:51.327154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-73b69a99-4710-4669-8722-9b903660cad1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.256472 Nov 22 13:45:51.328413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 160/357] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:51 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:51.414867 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:51.424328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7fe6f407-758b-4bea-b9de-711ae288efd0 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.206566 Nov 22 13:45:51.432721 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 198/358] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:51 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:51.657474 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:51.658091 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: ef0f8ad0-e330-4a6c-a10d-281daae5598e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:51.664334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.664785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.665596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.666572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.679592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] HTTP exception thrown: Instance ef0f8ad0-e330-4a6c-a10d-281daae5598e could not be found. Nov 22 13:45:51.680175 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Returning 404 to user: Instance ef0f8ad0-e330-4a6c-a10d-281daae5598e could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:45:51.680983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-69eb072c-fc1d-41ec-b0e2-906331b50166 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e" status: 404 len: 111 microversion: 2.1 time: 0.027209 Nov 22 13:45:51.681541 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 161/359] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:51 2021] GET /compute/v2.1/servers/ef0f8ad0-e330-4a6c-a10d-281daae5598e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:45:51.777304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-192038253", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "369cd7dd-1c9d-49ea-964a-b204a6cb66f8"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:51.830039 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] validate_networks() for [('369cd7dd-1c9d-49ea-964a-b204a6cb66f8', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:45:51.834533 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c39bd290-ebb7-4715-ab55-fca1b4fa8905 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:51.841536 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c39bd290-ebb7-4715-ab55-fca1b4fa8905 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.841929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c39bd290-ebb7-4715-ab55-fca1b4fa8905 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.902587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c39bd290-ebb7-4715-ab55-fca1b4fa8905 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Going to try to stop instance {{(pid=122684) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 13:45:51.952653 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c39bd290-ebb7-4715-ab55-fca1b4fa8905 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.121559 Nov 22 13:45:51.953278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 162/360] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:45:51 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:45:51.962563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:51.963968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:51.971697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.972454 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:51.973899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:51.974351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.114891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:52.122811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d02455bf-3b80-4c05-9055-f056e58c51fc tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.165313 Nov 22 13:45:52.123370 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 163/361] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:51 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:52.182410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:45:52.182786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:45:52.183214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:45:52.183628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:45:52.184038 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:45:52.194266 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.194656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.195365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.195794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.212528 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Getting quotas for project 0ef5dbba9eac4d15aec9b4a4e94cc84c. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:45:52.217649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Getting quotas for user 7b83b4c5360b4784955f51617f76fadb and project 0ef5dbba9eac4d15aec9b4a4e94cc84c. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:45:52.228312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:45:52.230539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:52.231119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:45:52.231629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:52.237766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.238215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.238990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.239419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.278869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-85dc7182-628a-4be6-b733-eac322b9546f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505341 Nov 22 13:45:52.279717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 199/362] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:45:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:45:52.289592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e42cf5b6-fa4a-40aa-b1ce-8ff459a306df tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:52.290201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e42cf5b6-fa4a-40aa-b1ce-8ff459a306df tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:52.349973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e42cf5b6-fa4a-40aa-b1ce-8ff459a306df tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:52.357127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e42cf5b6-fa4a-40aa-b1ce-8ff459a306df tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1213 microversion: 2.1 time: 0.071162 Nov 22 13:45:52.357738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 200/363] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:52 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:52.361955 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:52.362625 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:52.368319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.368776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.370240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.370692 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.395454 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:52.404763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-63c348dc-0ac2-410d-bf1d-69b2698c94bd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.177771 Nov 22 13:45:52.405451 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 164/364] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:52 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:52.441697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:52.442498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:52.448988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.449486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.450312 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:52.450762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:52.526399 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:52.537922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c6a71973-9c26-483e-8a0a-bc9a017a94f5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.178540 Nov 22 13:45:52.539109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 201/365] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:52 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:52.625407 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:52.633325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c42c02a0-0d1f-4cd4-a4fc-84d3d527a066 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.195121 Nov 22 13:45:52.633896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 165/366] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:52 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:53.139748 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:53.140351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:53.146556 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.146999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.147771 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.148200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.278799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:53.286841 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7e6b82df-fc73-400c-88f6-d2388a473f89 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.150767 Nov 22 13:45:53.287400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 202/367] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:53 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:53.373910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:53.374519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:53.380983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.381463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.382731 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.383164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.422283 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:53.422986 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:53.429008 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.429572 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.430432 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.430942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.445698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:53.453590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f5a049a7-64bf-4a09-a1c0-18df77a281c2 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1217 microversion: 2.1 time: 0.083184 Nov 22 13:45:53.454300 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 166/368] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:53 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:53.555632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:53.556373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:53.562796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.563244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.563688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:53.564020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.564452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.571099 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-35638c44-f900-45b8-9e52-77ce8902c490 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.152608 Nov 22 13:45:53.571669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 203/369] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:53 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:53.650746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:53.651567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:53.657406 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.657850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.658622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:53.659052 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:53.699778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:53.707194 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fba2f0a9-2a18-49f3-a22d-72e6f0dd8f25 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.155252 Nov 22 13:45:53.707954 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 167/370] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:53 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:53.789828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:53.797498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cdd3ce9e-300c-47cd-8942-fbffc73cfd7d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.150347 Nov 22 13:45:53.798060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 204/371] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:53 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:54.303333 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:54.303979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:54.309981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.310435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.311229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.311667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.443258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:54.452522 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d974d316-5e88-4e68-a3a7-d65e20b32a50 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.152640 Nov 22 13:45:54.453108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 168/372] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:54 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:54.470094 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:54.470704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:54.477483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.477864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.479121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.479740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.543293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:54.550525 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-40a5ca18-1179-40f0-b4fc-311483e9498f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1217 microversion: 2.1 time: 0.084001 Nov 22 13:45:54.551076 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 205/373] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:54 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:54.587666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:54.588804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:54.594557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.595007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.595846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.596285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.724844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:54.725489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:54.732034 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.732403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.733213 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.733659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.738842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:54.747789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f551a2b8-9ab1-4b66-b4f9-0ae24ddd7d1b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.163744 Nov 22 13:45:54.748558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 169/374] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:54 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:54.815109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:54.815858 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:54.821863 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.822535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.823566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:54.824227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:54.881881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:54.889185 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-de0e1ff5-c718-4063-9a55-ceb93cfba809 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.167963 Nov 22 13:45:54.889768 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 206/375] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:54 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:54.964452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:54.971642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2b7b1c42-4ce7-400c-b223-70ded41b2780 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.160863 Nov 22 13:45:54.972199 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 170/376] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:54 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:55.471101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:55.471752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:55.478049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.479245 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.480024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.480649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.567386 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:55.568002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:55.578873 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.579294 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.580247 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.580837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.648301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:55.657616 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-97d12db0-b3b8-4b05-b4db-7871e2568e0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.190237 Nov 22 13:45:55.658420 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 207/377] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:55 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:55.767201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:55.767201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:55.772700 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.773372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.774342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.774938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.872638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:55.881427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-238724ff-bfca-4673-9aa0-f5c81d2284ff tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1271 microversion: 2.1 time: 0.317447 Nov 22 13:45:55.891255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 171/378] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:55 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:55.910727 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:55.911727 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:55.918357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.918847 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.919781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:55.920324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:55.976477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:55.991362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9add73a3-b40e-4076-928a-e5b27eb3d763 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.229295 Nov 22 13:45:55.991944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 208/379] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:55 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:56.007752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:56.008543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:56.019253 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.020035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.020941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.021622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.155680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:56.163066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3bd76eac-b4c6-4abc-95ce-1e959da76db5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.257229 Nov 22 13:45:56.163716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 172/380] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:55 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:56.181287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:56.190785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-84adfe70-3d66-4b14-bf53-7c4a6a1a7474 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.187528 Nov 22 13:45:56.191417 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 209/381] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:56 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:56.675357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:56.675889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:56.682343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.682773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.683556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.683991 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.898764 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:56.899838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:56.902350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:56.906114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.906563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.907350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:56.907782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:56.912216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a36f16df-9ddd-439f-a45d-df063ac83023 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.240009 Nov 22 13:45:56.912887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 173/382] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:56 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:56.982287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-5ce08e00-dec4-4540-834d-d128285606db req-8aa2978e-fb9e-4ccf-9ccc-d5973c0e3323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99dcd4c-bf9c-424d-b969-5b4b52e1fb33", "tag": "2f90c99e-9d76-4b04-b298-a9096f93004f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:56.984445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:56.984445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:45:57.005875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5ce08e00-dec4-4540-834d-d128285606db req-8aa2978e-fb9e-4ccf-9ccc-d5973c0e3323 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.007079 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5ce08e00-dec4-4540-834d-d128285606db req-8aa2978e-fb9e-4ccf-9ccc-d5973c0e3323 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.019719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-5ce08e00-dec4-4540-834d-d128285606db req-8aa2978e-fb9e-4ccf-9ccc-d5973c0e3323 service nova] Creating event network-changed:2f90c99e-9d76-4b04-b298-a9096f93004f for instance d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 on hv-cinder-76845 Nov 22 13:45:57.025763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-5ce08e00-dec4-4540-834d-d128285606db req-8aa2978e-fb9e-4ccf-9ccc-d5973c0e3323 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052212 Nov 22 13:45:57.026524 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 174/383] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:45:57.031712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:57.032626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:57.042036 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.042797 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.043827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.044571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.063211 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:57.072858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-60868688-4d3e-44f6-ae8f-40c040594f6b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.176553 Nov 22 13:45:57.077743 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 210/384] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:56 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:57.179710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:57.180249 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:57.187711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.188317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.189408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.189946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.268299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:57.275935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-45611e68-95c9-41ec-bc0b-a286ecf5b27b tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.248071 Nov 22 13:45:57.276738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 175/385] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:57 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:57.281886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:57.282663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:57.297019 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.297681 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.298632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.299224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.362503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:57.374785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9f3596a9-64c6-420a-b7f5-ab53d79ef17a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.198607 Nov 22 13:45:57.376173 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 211/386] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:57 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:57.381591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-3fd32335-77f7-4b11-83c5-ff179f79fb0e req-1062cfcb-e08f-47a0-a3ee-8d12ae556229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad79f610-9b3d-4c71-a797-2b9ec9602b6c", "name": "network-vif-plugged", "status": "completed", "tag": "64d8bc36-2015-4ba9-8e04-f54b659d4fa1"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:57.383375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:57.383375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:57.392556 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-3fd32335-77f7-4b11-83c5-ff179f79fb0e req-1062cfcb-e08f-47a0-a3ee-8d12ae556229 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.392994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-3fd32335-77f7-4b11-83c5-ff179f79fb0e req-1062cfcb-e08f-47a0-a3ee-8d12ae556229 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.406931 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-3fd32335-77f7-4b11-83c5-ff179f79fb0e req-1062cfcb-e08f-47a0-a3ee-8d12ae556229 service nova] Creating event network-vif-plugged:64d8bc36-2015-4ba9-8e04-f54b659d4fa1 for instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c on hv-cinder-76845 Nov 22 13:45:57.412529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-3fd32335-77f7-4b11-83c5-ff179f79fb0e req-1062cfcb-e08f-47a0-a3ee-8d12ae556229 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034972 Nov 22 13:45:57.413499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 212/387] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:57.582631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:57.593556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dfdf3cb0-48c7-449d-9ce9-7a90b13d6b58 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.315572 Nov 22 13:45:57.596035 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 176/388] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:57 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:57.931158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:57.931858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:57.938455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.938904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:57.939679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:57.940117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.090848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:58.091469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:58.097766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.098210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.098998 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.099437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.130936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:58.139789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-00b381db-152b-43f8-8df8-f2c66884d1ac tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.213074 Nov 22 13:45:58.140800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 213/389] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:57 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:58.256493 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:58.264996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a274afe8-b124-427d-b4d3-adc02145f5bf tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.177810 Nov 22 13:45:58.265986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 177/390] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:58 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:58.294750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:58.295410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:58.302093 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.302714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.303742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.304187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.393285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:58.394194 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:58.400614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.401239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.402222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.402770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.555222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:58.564772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-96f6ebc2-48f1-4e82-b949-18552dfe0744 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1266 microversion: 2.1 time: 0.175112 Nov 22 13:45:58.584667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 178/391] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:58 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:58.614523 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:58.615672 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:58.624986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.625907 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.627927 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:58.628978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:58.749226 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:58.760673 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-459c39aa-56d1-44c9-822d-71242d9578db tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.471070 Nov 22 13:45:58.767577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 214/392] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:58 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:58.818622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:58.826325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a5424c91-ea79-4f4e-9f43-bd89f8f805f3 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.217064 Nov 22 13:45:58.826896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 179/393] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:58 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:59.156117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.157514 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.163711 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.164159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.164932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.165386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.282752 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.284710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.293860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.294626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.295891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.296599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.307131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:59.319485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-169a67d4-4e4a-47b2-8640-ff8a4339eba3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.167276 Nov 22 13:45:59.320064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 215/394] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:59.438473 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-5f064cf8-ecec-48de-a756-7ee4be0b144d req-dc51050c-4e56-4a1f-8f0a-60bd61627bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f43fb42-29e7-4162-a4a2-4f4d6f790d7c", "name": "network-vif-plugged", "status": "completed", "tag": "2d483769-a043-4eb0-92ac-80f96ec6440c"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:45:59.440438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:45:59.440438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:45:59.447778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f064cf8-ecec-48de-a756-7ee4be0b144d req-dc51050c-4e56-4a1f-8f0a-60bd61627bb7 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.448325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f064cf8-ecec-48de-a756-7ee4be0b144d req-dc51050c-4e56-4a1f-8f0a-60bd61627bb7 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.453143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:59.462028 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e9d9fade-d83d-4865-bca8-f53cd47ca0e4 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.183072 Nov 22 13:45:59.462899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 180/395] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:59.466577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-5f064cf8-ecec-48de-a756-7ee4be0b144d req-dc51050c-4e56-4a1f-8f0a-60bd61627bb7 service nova] Creating event network-vif-plugged:2d483769-a043-4eb0-92ac-80f96ec6440c for instance 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c on hv-cinder-76845 Nov 22 13:45:59.471552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-5f064cf8-ecec-48de-a756-7ee4be0b144d req-dc51050c-4e56-4a1f-8f0a-60bd61627bb7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037510 Nov 22 13:45:59.472506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 216/396] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:45:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:45:59.596955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.597695 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.603709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.604242 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.605746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.606606 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.754222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:59.762241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-78d09095-df39-41e0-9dbb-a7f640b60f0c tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1454 microversion: 2.1 time: 0.169834 Nov 22 13:45:59.762960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 181/397] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:59.779868 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.780214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.780868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.780994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.787047 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.787186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.787627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.787739 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.788414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.788526 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.788843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.788970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.940859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:59.942597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:45:59.949913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cd7b6002-1c06-4f82-925f-5dbaa2985977 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.174566 Nov 22 13:45:59.951070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cebc5b01-19be-45b2-a8aa-2ce0978ab324 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1454 microversion: 2.1 time: 0.175941 Nov 22 13:45:59.951649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 217/398] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:45:59.960580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 182/399] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:45:59.963887 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:45:59.965154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:45:59.971895 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.972538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:45:59.973593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:45:59.974110 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.293036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:00.305013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bc8aac33-331b-4621-a345-53ab8b026b52 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.352165 Nov 22 13:46:00.305618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 218/400] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:45:59 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:00.336612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:00.338331 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:00.346005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.346675 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.347600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.348181 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.480548 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:00.482144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:00.489940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.490653 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.491508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.491979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.624397 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:00.634523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:00.634766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-00f6b386-91b4-4cc7-8b30-2989162b91b8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.302251 Nov 22 13:46:00.635343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 183/401] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:00 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:00.650776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-36768fda-b01b-4856-8e0d-bac3c72229bd tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.174804 Nov 22 13:46:00.651462 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 219/402] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:00 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:00.968055 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:00.968737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:00.975133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.975911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:00.976879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:00.977349 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.322894 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:01.323676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:01.330383 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.330941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.331878 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.332394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.503904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:01.513404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ee861d2b-d55e-41af-8dc5-516f91e999cc tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1318 microversion: 2.1 time: 0.193997 Nov 22 13:46:01.523781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 220/403] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:01 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:01.596135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:01.604875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3c0c6b62-68f4-4a55-b7d1-b8744a8dffc5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.640762 Nov 22 13:46:01.605503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 184/404] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:00 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:01.652498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:01.653502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:01.659361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.659903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.660788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.661333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.668823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:01.669476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:01.675844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.676519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.677530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.678146 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.834961 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:01.845531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-31baddd3-a22b-4099-8f65-cd1359609a5c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.197018 Nov 22 13:46:01.846096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 221/405] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:01 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:01.851046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1f9b6fc-43d2-4116-965c-3110b2d57e0d"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:01.852365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:01.858461 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.858942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.859761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:01.860201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:01.934308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:01.938514 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Invalid volume: volume d1f9b6fc-43d2-4116-965c-3110b2d57e0d is already attached to instances: 16f49825-783b-4991-9213-98c29527695e Nov 22 13:46:01.939119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 400 to user: Invalid volume: volume d1f9b6fc-43d2-4116-965c-3110b2d57e0d is already attached to instances: 16f49825-783b-4991-9213-98c29527695e {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:46:01.939942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5464ad5c-159b-4e01-8792-297be9ed8d87 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092953 Nov 22 13:46:01.941009 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 222/406] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:46:01 2021] POST /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 13:46:01.945093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e968516e-c1d7-4095-a4f3-82b3c92995ea tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.280938 Nov 22 13:46:01.945883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 185/407] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:01 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:01.998789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:01.999215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.005845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.006295 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.007071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.007520 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.133795 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'services' on Instance uuid 16f49825-783b-4991-9213-98c29527695e {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:46:02.288250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7bf16c46-9820-452a-aeb1-9b80b2dd6cf3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments/d1f9b6fc-43d2-4116-965c-3110b2d57e0d" status: 202 len: 0 microversion: 2.1 time: 0.293721 Nov 22 13:46:02.293024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 223/408] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:46:01 2021] DELETE /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments/d1f9b6fc-43d2-4116-965c-3110b2d57e0d => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:46:02.309175 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:02.320465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.328448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.329081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.330670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.331292 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.364805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-330cd052-1c39-4ea3-b9ed-4f7f4da9d88f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070604 Nov 22 13:46:02.365969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 186/409] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:02 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:46:02.532777 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:02.535263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.543315 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.544016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.544811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.545268 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.545401 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-48c666eb-b3f8-4340-a828-0e1656760299 req-041c3ce6-66eb-4dcb-a5e3-e6addc3c15ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad79f610-9b3d-4c71-a797-2b9ec9602b6c", "tag": "64d8bc36-2015-4ba9-8e04-f54b659d4fa1"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:02.546887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:02.546887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:02.554272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-48c666eb-b3f8-4340-a828-0e1656760299 req-041c3ce6-66eb-4dcb-a5e3-e6addc3c15ff service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.554958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-48c666eb-b3f8-4340-a828-0e1656760299 req-041c3ce6-66eb-4dcb-a5e3-e6addc3c15ff service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.571085 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-48c666eb-b3f8-4340-a828-0e1656760299 req-041c3ce6-66eb-4dcb-a5e3-e6addc3c15ff service nova] Creating event network-changed:64d8bc36-2015-4ba9-8e04-f54b659d4fa1 for instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c on hv-cinder-76845 Nov 22 13:46:02.576964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-48c666eb-b3f8-4340-a828-0e1656760299 req-041c3ce6-66eb-4dcb-a5e3-e6addc3c15ff service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035040 Nov 22 13:46:02.578304 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 187/410] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:46:02.625101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:02.626952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.634299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.634811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.636542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.637361 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.710706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:02.720145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8d6a9588-fda0-4546-af2e-4af8b475dbf8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1507 microversion: 2.1 time: 0.193176 Nov 22 13:46:02.734720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 224/411] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:02 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:02.796044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:02.803799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5e3033e0-1c95-42ae-8aac-2ee27d8ab4f2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.184477 Nov 22 13:46:02.804369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 188/412] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:02 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:02.869678 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:02.871756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.886122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.886865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.887871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.888465 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.962985 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:02.964294 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:02.975100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.977874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:02.978873 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:02.979323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:03.203665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:03.217600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9375f582-87ed-4074-a69d-15d59f34f732 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.258625 Nov 22 13:46:03.226957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 189/413] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:02 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:03.260245 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:03.270500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3e9ae3be-aed4-4faf-bd18-723c83672030 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.411260 Nov 22 13:46:03.271473 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 225/414] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:02 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:03.376651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:03.377701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:03.387919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:03.388786 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:03.390808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:03.391381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:03.423239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-eb6f8a4b-74f0-4d1a-870b-152a0da1a444 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Nov 22 13:46:03.427582 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 190/415] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:03 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:03.823948 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:03.825189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:03.832642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:03.833385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:03.834510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:03.835051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:03.981275 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:03.988564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-140292e6-2fda-43c6-b822-8200b8a96a4a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.169831 Nov 22 13:46:03.989125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 226/416] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:03 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:04.234383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:04.234983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:04.240948 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.241440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.242212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.242653 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.287662 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:04.288271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:04.294239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.294696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.295482 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.295922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.377258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:04.385177 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8c8cf958-bdfe-4883-a8af-e0e3828251d3 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.154406 Nov 22 13:46:04.387132 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 191/417] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:04 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:04.436900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:04.438082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:04.444938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:04.447403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.448430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.449688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:04.450353 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:04.459332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b0978636-f1c2-4ce2-b0ba-93c7902e365d tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.175115 Nov 22 13:46:04.460010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 227/418] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:04 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:04.494067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1092ee67-ece7-4c32-8681-47297ebb479b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062571 Nov 22 13:46:04.494636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 192/419] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:04 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:46:04.647605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1381643243", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "a84a04f9-b201-43c0-84cd-ce6ec22f409e"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:04.708722 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] validate_networks() for [('a84a04f9-b201-43c0-84cd-ce6ec22f409e', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:46:05.005806 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:05.006411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.013534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.013995 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.014993 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.015461 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.096451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:46:05.096980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:46:05.097511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:46:05.097994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:46:05.098483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:46:05.108824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.109390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.110245 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.110685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.129752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:46:05.133967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Getting quotas for user bcfdb2c09693488588c0a7b1232739e0 and project c53dd94dbfdb43e48d2ed35368bd14a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:46:05.146420 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:46:05.148953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:46:05.149130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:05.157113 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1bbc2f71-d40a-43f4-a702-5c9582748b00 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1500 microversion: 2.1 time: 0.155100 Nov 22 13:46:05.157750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 193/420] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:05 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:05.175287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3468914b-d0d5-439e-aeca-5ea256e60dd8"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:05.176376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.184196 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.184696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.185555 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.186007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.195897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-aa1626fc-6175-46f0-9ca7-da93bcb90b89 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553241 Nov 22 13:46:05.197015 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 228/421] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:46:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:46:05.206434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-446a58c0-7ab4-4183-8b2b-244c6b8f9776 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:05.207059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-446a58c0-7ab4-4183-8b2b-244c6b8f9776 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.217710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] HTTP exception thrown: Cannot 'attach_volume' instance 067f06e1-5203-4223-bdb1-f364f84ccaaa while it is in vm_state rescued Nov 22 13:46:05.218271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Returning 409 to user: Cannot 'attach_volume' instance 067f06e1-5203-4223-bdb1-f364f84ccaaa while it is in vm_state rescued {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:46:05.219334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9df4236c-9fb0-4d6f-bbba-f1110b1c2de1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048004 Nov 22 13:46:05.220049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 194/422] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:46:05 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 22 13:46:05.228273 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:05.229049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.236400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.237578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.238580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.239374 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.264863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-446a58c0-7ab4-4183-8b2b-244c6b8f9776 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:05.272226 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-446a58c0-7ab4-4183-8b2b-244c6b8f9776 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1218 microversion: 2.1 time: 0.069063 Nov 22 13:46:05.273240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 229/423] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:05 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:05.328288 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cd4861d5-670b-43d7-bf30-b15d145a3fd3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action" status: 202 len: 0 microversion: 2.1 time: 0.103297 Nov 22 13:46:05.329257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 195/424] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:46:05 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:46:05.345853 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:05.346653 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.359365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.359855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.360826 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.361169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.404288 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:05.405217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.416610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.418023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.419166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.419786 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.613597 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:05.621264 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ee22c86a-8537-4c08-acbf-ff51155ca1d0 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.222156 Nov 22 13:46:05.621922 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 196/425] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:05 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:05.629756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-0a8708e0-2edf-4b34-a4bf-40762e4714f1 req-dfd20386-d89b-4e51-9df5-9e63d2f4b0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99dcd4c-bf9c-424d-b969-5b4b52e1fb33", "name": "network-vif-plugged", "status": "completed", "tag": "2f90c99e-9d76-4b04-b298-a9096f93004f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:05.634872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:05.634872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:05.643561 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-0a8708e0-2edf-4b34-a4bf-40762e4714f1 req-dfd20386-d89b-4e51-9df5-9e63d2f4b0ec service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.644105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-0a8708e0-2edf-4b34-a4bf-40762e4714f1 req-dfd20386-d89b-4e51-9df5-9e63d2f4b0ec service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.652670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:05.656794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-0a8708e0-2edf-4b34-a4bf-40762e4714f1 req-dfd20386-d89b-4e51-9df5-9e63d2f4b0ec service nova] Creating event network-vif-plugged:2f90c99e-9d76-4b04-b298-a9096f93004f for instance d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 on hv-cinder-76845 Nov 22 13:46:05.662053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-0a8708e0-2edf-4b34-a4bf-40762e4714f1 req-dfd20386-d89b-4e51-9df5-9e63d2f4b0ec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 Nov 22 13:46:05.662835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 197/426] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:05.669441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:05.670184 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:05.671117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-86bbf33e-82c0-4789-b266-440ed9d1f185 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1508 microversion: 2.1 time: 0.336102 Nov 22 13:46:05.671992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 230/427] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:05 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:05.686530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.687007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.687798 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:05.688234 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:05.858125 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:05.867627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a049197a-881e-41aa-80ca-e253c2e56dee tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.203337 Nov 22 13:46:05.868292 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 198/428] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:05 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:06.290928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:06.291541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:06.297765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.298245 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.299021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.299456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.359650 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:06.366770 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5f25de5d-dee3-46c7-ac27-f90b32372bba tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1270 microversion: 2.1 time: 0.079583 Nov 22 13:46:06.367325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 231/429] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:06 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:06.639515 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:06.640126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:06.646684 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.647130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.647900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.648327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.688225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:06.688931 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:06.694702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.695159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.695955 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.696397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.786171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:06.794205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f61920db-2fd9-414b-ba7a-212ad93faa8a tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.158510 Nov 22 13:46:06.794775 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 199/430] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:06 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:06.839631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:06.846854 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ef77528a-82bc-48dd-86af-03614388fbe0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1508 microversion: 2.1 time: 0.162307 Nov 22 13:46:06.847424 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 232/431] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:06 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:06.885655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:06.886265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:06.891931 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.892383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:06.893249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:06.893646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.022920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:07.031573 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-590459c2-aeec-475b-aced-03cbb46ad0a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.149528 Nov 22 13:46:07.032140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 200/432] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:06 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:07.387577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:07.388976 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:07.395766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.396540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.397884 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.398392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.474740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:07.484171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5bc2073b-0087-4c5a-9751-3aa3ef571be7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1276 microversion: 2.1 time: 0.102071 Nov 22 13:46:07.485083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 233/433] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:07 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:07.811526 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:07.812325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:07.819536 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.820029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.820774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.821241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.863771 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:07.864693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:07.872390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.873584 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:07.874410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:07.874836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.004829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:08.015585 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-335fcbd3-42db-4b72-ab63-13451be11a94 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1313 microversion: 2.1 time: 0.208406 Nov 22 13:46:08.017019 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 201/434] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:07 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:08.062715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:08.064986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:08.078068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:08.078954 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.080539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:08.081885 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.195082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:08.208048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fcedb012-b91b-4aba-a76a-00fa670c65b5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1508 microversion: 2.1 time: 0.347461 Nov 22 13:46:08.210183 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 234/435] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:07 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:08.318320 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:08.327310 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0c3fb9be-dc92-42d5-a079-d3b9923ad9af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.277578 Nov 22 13:46:08.328413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 202/436] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:08 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:08.501763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:08.502876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:08.510258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:08.511586 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.512718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:08.513447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.758155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:08.766368 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a73a5c6a-b9ba-450e-bbff-b77eb51f06f7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.268661 Nov 22 13:46:08.766919 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 235/437] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:08 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:08.898015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-2710b15c-f167-447a-907d-c054b1cc352f req-39b7030f-b442-4716-bd7c-79d072a8dc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc1627d-2a2c-4ac6-b832-9ab05b4da015", "tag": "38144404-1539-410c-a098-200cd008d0f8"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:08.901808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:08.901808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:08.911463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-2710b15c-f167-447a-907d-c054b1cc352f req-39b7030f-b442-4716-bd7c-79d072a8dc39 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:08.911920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-2710b15c-f167-447a-907d-c054b1cc352f req-39b7030f-b442-4716-bd7c-79d072a8dc39 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:08.933225 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-2710b15c-f167-447a-907d-c054b1cc352f req-39b7030f-b442-4716-bd7c-79d072a8dc39 service nova] Creating event network-changed:38144404-1539-410c-a098-200cd008d0f8 for instance 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 on hv-cinder-76845 Nov 22 13:46:08.938169 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-2710b15c-f167-447a-907d-c054b1cc352f req-39b7030f-b442-4716-bd7c-79d072a8dc39 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045883 Nov 22 13:46:08.939325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 203/438] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:09.033152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:09.033871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:09.039653 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.040265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.041115 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.041650 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.227468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:09.228174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:09.235757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.236700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.237374 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.237813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.445747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:09.455312 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4232952e-3fae-4412-b308-a9bfea84bae9 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1508 microversion: 2.1 time: 0.231684 Nov 22 13:46:09.456210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 204/439] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:09 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:09.469685 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:09.470703 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:09.481473 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.482212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.483431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.484223 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.484752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:09.497798 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-eabdd741-6b36-4cc8-bd17-211bf9c536f8 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1496 microversion: 2.1 time: 0.467903 Nov 22 13:46:09.498502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 236/440] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:09 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1496 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:09.641398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:09.650102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e48cacc8-ff22-484d-8e95-a83a8717ad0e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.192491 Nov 22 13:46:09.660560 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 205/441] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:09 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:09.784045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:09.784656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:09.791974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.792423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:09.793358 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:09.793822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.073566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:10.082232 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d0fe87e2-ca02-4794-a422-fbdcb85a7fa5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.302772 Nov 22 13:46:10.082802 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 237/442] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:09 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:10.262080 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:10.262596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:10.269081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.269558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.270340 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.270776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.297713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:46:10.392567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4b0c4d9e-cb1b-4933-bd26-b498b0bfa66b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 204 len: 0 microversion: 2.1 time: 0.134389 Nov 22 13:46:10.393615 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 206/443] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:46:10 2021] DELETE /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:46:10.401807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:10.402613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:10.408310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.408769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.409582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.410019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.474221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:10.474929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:10.481422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.481932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.482835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.483281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.578603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:10.587492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a022e826-dfee-4a7e-b0eb-e414ef14ec86 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1502 microversion: 2.1 time: 0.189869 Nov 22 13:46:10.588225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 238/444] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:10 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:10.648890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:10.656827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fb28a6b2-5974-4e94-bb49-fdba0a89d364 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1514 microversion: 2.1 time: 0.187165 Nov 22 13:46:10.657427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 207/445] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:10 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:10.669340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:10.670303 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:10.676542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.677028 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.677808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:10.678244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:10.826768 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:10.836334 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-def5c58c-1b4a-476d-8ffe-37c5857271f7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.171999 Nov 22 13:46:10.836912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 239/446] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:10 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:11.098962 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:11.099909 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:11.106728 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.107176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:11.107952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.108388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:11.240678 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:11.248698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a9d5c783-5e30-4885-872b-c7ec7e18e227 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.153368 Nov 22 13:46:11.249283 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 208/447] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:11 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:11.607105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:11.607919 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:11.614171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.614838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:11.615622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.616166 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:11.757104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:11.764938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c9480767-2b7e-47ff-93b6-b6ae29651c6f tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1502 microversion: 2.1 time: 0.162342 Nov 22 13:46:11.766250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 240/448] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:11 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:11.854381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:11.855088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:11.862793 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.863238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:11.864022 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:11.864455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.001801 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:12.010200 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4ae7d974-beeb-4666-8992-44b66cc0b912 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.159914 Nov 22 13:46:12.010992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 209/449] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:11 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:12.030341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:12.030954 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:12.037171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.037660 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.038442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.038885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.168867 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:12.176190 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c6492732-d374-4730-9de8-123c482c0cfe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1514 microversion: 2.1 time: 0.150290 Nov 22 13:46:12.176827 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 241/450] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:12 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:12.192299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2b342ae-9813-4ab3-9fca-4354527f0dd1"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:12.193499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:12.200744 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.201242 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.202043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.202484 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.266256 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:12.266911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:12.272620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.273065 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.273878 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.274326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.422562 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:12.429766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b6d8d71e-c39b-4407-b525-1858b77ba667 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.167476 Nov 22 13:46:12.430377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 242/451] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:12 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:12.485257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-412b105c-3c8d-4359-9de4-612e853501dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296392 Nov 22 13:46:12.485952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 210/452] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:46:12 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:12.783046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:12.783723 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:12.789639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.790090 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.790865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:12.791302 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:12.930433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:12.938868 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-13ed8124-69e2-421e-abe7-63ca705e104b tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1502 microversion: 2.1 time: 0.159583 Nov 22 13:46:12.939436 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 243/453] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:12 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:13.030608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:13.031321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:13.037712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.038102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.038891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.039332 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.182211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:13.190635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-434266b2-062e-4fa5-8040-e831e2ee2ed5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.165661 Nov 22 13:46:13.191206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 211/454] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:13 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:13.446814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:13.447424 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:13.454849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.455318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.456139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.456571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.488465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-62ac75f9-0c13-43a9-8916-c62be6612959 req-d5bd1ca4-8d99-47db-92a6-e9a911cc54bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99dcd4c-bf9c-424d-b969-5b4b52e1fb33", "name": "network-vif-deleted", "tag": "2f90c99e-9d76-4b04-b298-a9096f93004f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:13.490388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:13.490388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:13.501066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-62ac75f9-0c13-43a9-8916-c62be6612959 req-d5bd1ca4-8d99-47db-92a6-e9a911cc54bd service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.501955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-62ac75f9-0c13-43a9-8916-c62be6612959 req-d5bd1ca4-8d99-47db-92a6-e9a911cc54bd service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.523835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-62ac75f9-0c13-43a9-8916-c62be6612959 req-d5bd1ca4-8d99-47db-92a6-e9a911cc54bd service nova] Creating event network-vif-deleted:2f90c99e-9d76-4b04-b298-a9096f93004f for instance d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 on hv-cinder-76845 Nov 22 13:46:13.530577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-62ac75f9-0c13-43a9-8916-c62be6612959 req-d5bd1ca4-8d99-47db-92a6-e9a911cc54bd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046790 Nov 22 13:46:13.531757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 212/455] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:13.637925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:13.651489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d19d2c0a-31ca-4063-9e28-7cfe920e373e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.208421 Nov 22 13:46:13.652067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 244/456] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:13 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:13.960618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:13.961362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:13.968557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.969030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:13.969814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:13.970251 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.002997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:14.003715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.004167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lazy-loading 'fault' on Instance uuid d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:46:14.051883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b83b4c5360b4784955f51617f76fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef5dbba9eac4d15aec9b4a4e94cc84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:14.061237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4ba49f5c-d61c-4d39-9eb0-5a115c05b53e tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 200 len: 1303 microversion: 2.1 time: 0.104474 Nov 22 13:46:14.062212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 213/457] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:13 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:14.209908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:14.210952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:14.218346 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:14.218830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.219838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:14.220578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.359425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:14.367222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f988bb7a-88f8-4363-a889-da45587ff281 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1724 microversion: 2.1 time: 0.162413 Nov 22 13:46:14.367779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 245/458] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:14 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:14.668943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:14.669642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:14.676018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:14.676466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.677282 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:14.677721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:14.809316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:14.817211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-496e02fe-8b7e-45d0-b341-bcc894e9e4c5 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.152041 Nov 22 13:46:14.817787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 214/459] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:14 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:15.079041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:15.079659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] [instance: d99dcd4c-bf9c-424d-b969-5b4b52e1fb33] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:15.086003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.086459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.087241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.087682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.100972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] HTTP exception thrown: Instance d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 could not be found. Nov 22 13:46:15.101597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] Returning 404 to user: Instance d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:46:15.102442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4c556cd0-394e-487e-b20a-0382fa860e36 tempest-VolumesActionsTest-1395534184 tempest-VolumesActionsTest-1395534184-project] 10.222.0.31 "GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33" status: 404 len: 111 microversion: 2.1 time: 0.027822 Nov 22 13:46:15.102988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 246/460] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:15 2021] GET /compute/v2.1/servers/d99dcd4c-bf9c-424d-b969-5b4b52e1fb33 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:46:15.383880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:15.384567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:15.391743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.392278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.393067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.393533 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.742746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:15.751190 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-21e4421c-05fe-498f-8091-d5caf521176a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1701 microversion: 2.1 time: 0.371223 Nov 22 13:46:15.751762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 215/461] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:15 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1701 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:15.768311 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c12aa629-9fa7-4e8f-ac85-b4a42e4b81cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:15.774330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c12aa629-9fa7-4e8f-ac85-b4a42e4b81cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.774778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c12aa629-9fa7-4e8f-ac85-b4a42e4b81cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.835095 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:15.835646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:15.838874 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c12aa629-9fa7-4e8f-ac85-b4a42e4b81cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Going to try to start instance {{(pid=122685) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 13:46:15.841417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.841865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.842646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.843081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.880658 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c12aa629-9fa7-4e8f-ac85-b4a42e4b81cf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.115859 Nov 22 13:46:15.881459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 247/462] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:46:15 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:46:15.890514 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:15.891296 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:15.897777 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.898225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:15.899014 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:15.899451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:16.001937 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:16.013980 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-639f46b1-56eb-4793-9501-18a7c39890fc tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.182455 Nov 22 13:46:16.014901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 216/463] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:15 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:16.072844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:16.081695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e25c9366-c51e-4dca-909d-221e2f61af41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1710 microversion: 2.1 time: 0.195961 Nov 22 13:46:16.082253 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 248/464] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:15 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:17.031068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:17.031587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:17.038820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:17.039265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:17.040876 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:17.041339 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:17.099445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:17.100415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:17.107282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:17.107745 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:17.108536 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:17.108979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:17.181001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:17.189418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c2738c9e-578d-402b-b2b7-f1890e556d48 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.162108 Nov 22 13:46:17.193589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 217/465] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:17 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:17.249831 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:17.257929 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1306cc0a-4c95-4b55-8187-8067412c3bfb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1710 microversion: 2.1 time: 0.162200 Nov 22 13:46:17.258499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 249/466] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:17 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:17.466983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-854fdd07-da3b-40f5-8639-8b5f881a22c2 req-7fe88cc1-e2b0-4fc3-85b2-e4710b709081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc1627d-2a2c-4ac6-b832-9ab05b4da015", "name": "network-vif-plugged", "status": "completed", "tag": "38144404-1539-410c-a098-200cd008d0f8"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:17.468955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:17.468955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:17.479722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-854fdd07-da3b-40f5-8639-8b5f881a22c2 req-7fe88cc1-e2b0-4fc3-85b2-e4710b709081 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:17.480314 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-854fdd07-da3b-40f5-8639-8b5f881a22c2 req-7fe88cc1-e2b0-4fc3-85b2-e4710b709081 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:17.497504 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-854fdd07-da3b-40f5-8639-8b5f881a22c2 req-7fe88cc1-e2b0-4fc3-85b2-e4710b709081 service nova] Creating event network-vif-plugged:38144404-1539-410c-a098-200cd008d0f8 for instance 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 on hv-cinder-76845 Nov 22 13:46:17.503467 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-854fdd07-da3b-40f5-8639-8b5f881a22c2 req-7fe88cc1-e2b0-4fc3-85b2-e4710b709081 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040679 Nov 22 13:46:17.504202 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 218/467] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:18.206102 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:18.206701 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:18.212865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:18.213349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:18.214119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:18.214550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:18.276589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:18.277671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:18.284859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:18.285579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:18.286433 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:18.286960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:18.381335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:18.389979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6e61214e-eb47-412b-b38d-1811769365df tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.187380 Nov 22 13:46:18.390642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 250/468] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:18 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:18.454965 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:18.462592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bd6d5c2c-bc32-48e3-93af-6782f6ca05bb tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1714 microversion: 2.1 time: 0.190233 Nov 22 13:46:18.463149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 219/469] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:18 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1714 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:19.407517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:19.408122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:19.414500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:19.414946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:19.415786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:19.416230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:19.545148 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:19.552312 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f39fb284-dfb5-41b0-81a6-6bc8e4a9e044 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1318 microversion: 2.1 time: 0.148433 Nov 22 13:46:19.552891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 251/470] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:19 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:19.990178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:19.991123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:19.998245 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:19.998698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:19.999608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:20.000008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:20.024104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'flavor' on Instance uuid 067f06e1-5203-4223-bdb1-f364f84ccaaa {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:46:20.139606 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-638cbab2-627d-41ff-89ca-200a4e282851 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action" status: 200 len: 32 microversion: 2.1 time: 0.153057 Nov 22 13:46:20.140441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 220/471] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:46:19 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:46:20.150271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:20.150890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:20.157037 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:20.157516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:20.158300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:20.165730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:20.380325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:20.389222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-23b38f00-722b-4742-a013-48eca2d05df8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.243795 Nov 22 13:46:20.390193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 252/472] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:20 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:20.569439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:20.570239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:20.577123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:20.577123 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:20.577947 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:20.578380 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:20.719321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:20.726564 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c6b8df9c-f663-4a35-ab96-8fe5b0331eff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1508 microversion: 2.1 time: 0.161222 Nov 22 13:46:20.727135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 221/473] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:20 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:21.409179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:21.410197 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:21.422116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:21.422547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:21.423374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:21.423851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:21.559010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:21.567280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-aa874aeb-5c32-4dde-9281-2ebbb6634267 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.164407 Nov 22 13:46:21.567845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 253/474] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:21 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:22.034738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fd3e5d-c7ac-479f-bf1f-a75b7a3391ac"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:22.035871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:22.042082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:22.042534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:22.044086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:22.044529 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:22.289599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e92390a7-ee46-46ca-ab60-cb6478a81832 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "POST /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258309 Nov 22 13:46:22.290206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 222/475] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:46:22 2021] POST /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:22.585891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:22.586598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:22.593459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:22.593936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:22.594717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:22.595157 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:22.726189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:22.735509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-067a78d4-7a41-40bc-ab87-e390c381999c tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.153426 Nov 22 13:46:22.736073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 254/476] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:22 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:23.753701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:23.754391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:23.760805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:23.761285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:23.762102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:23.762530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:23.904176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:23.912143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0cf193e3-0a33-43e5-b1ec-79752454f4ee tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.163219 Nov 22 13:46:23.912711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 223/477] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:23 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:24.929667 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:24.930273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:24.936604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:24.937052 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:24.937865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:24.938298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:25.072821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:25.080533 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1b45bbcc-8713-4f57-ac8c-516d1b533d3e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.154493 Nov 22 13:46:25.081087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 255/478] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:24 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:26.097277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:26.097916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:26.104271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:26.104726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:26.106078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:26.106822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:26.251992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:26.260476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e16fe98b-7261-4409-afa1-3dc9d2824845 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.166953 Nov 22 13:46:26.261061 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 224/479] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:26 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:27.277072 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:27.277754 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:27.283508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:27.283958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:27.284732 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:27.285163 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:27.422629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:27.430447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c3ab390e-b32a-48a7-b6ea-acf00aa4d874 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.156895 Nov 22 13:46:27.431005 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 256/480] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:27 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:28.447533 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:28.448141 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:28.455180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:28.455628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:28.456406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:28.456838 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:28.589520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:28.598183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80d2b1dd-3369-4b5c-a2da-5c064fcce872 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.154260 Nov 22 13:46:28.598753 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 225/481] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:28 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:29.614625 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:29.615244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:29.621522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:29.621973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:29.622763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:29.623204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:29.754554 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:29.762351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ec862998-ecbc-4c2e-8415-57578bc346fa tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.151294 Nov 22 13:46:29.762913 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 257/482] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:29 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:30.779560 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:30.780174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:30.786417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:30.786866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:30.787642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:30.788079 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:30.917172 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:30.925485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c9513a7f-374f-4487-9a77-26bb8d467b76 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.150144 Nov 22 13:46:30.926055 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 226/483] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:30 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:31.942440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:31.943057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:31.949159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:31.949639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:31.950989 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:31.951374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:32.082209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:32.089839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-234f3abb-1e3f-4a57-95cb-c9bf9e97b422 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.151283 Nov 22 13:46:32.090403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 258/484] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:31 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:32.980913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:32.981446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:32.987795 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:32.988244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:32.989053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:32.989578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:33.071834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'services' on Instance uuid 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:46:33.107320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:33.108715 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:33.118542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:33.118994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:33.120203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:33.120980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:33.149648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e199f496-5502-42c2-9f88-65cdc1d4badf tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments/65fd3e5d-c7ac-479f-bf1f-a75b7a3391ac" status: 202 len: 0 microversion: 2.1 time: 0.171969 Nov 22 13:46:33.150293 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 227/485] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:46:32 2021] DELETE /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments/65fd3e5d-c7ac-479f-bf1f-a75b7a3391ac => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:46:33.160860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:33.162411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:33.171937 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:33.172961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:33.174063 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:33.174696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:33.213044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c424016f-cbe0-4181-84b9-5a2a6913fd6c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056946 Nov 22 13:46:33.217607 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 228/486] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:33 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:33.276371 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:33.285115 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d956b219-aa17-47b6-b008-f0cb71c7064f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.181577 Nov 22 13:46:33.285705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 259/487] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:33 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:34.227185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:34.228084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:34.238003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:34.238725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:34.239643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:34.240360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:34.277304 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-67d1397b-34d1-4a3b-8b6d-a463acdc0ff7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054018 Nov 22 13:46:34.277935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 229/488] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:34 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:34.303426 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:34.304027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:34.311297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:34.311980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:34.312945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:34.313404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:34.487442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:34.499805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7da55d1a-d469-4163-aef3-90432f2bdfe8 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.199980 Nov 22 13:46:34.501159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 260/489] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:34 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:35.289476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:35.290405 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:35.296750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:35.297187 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:35.298009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:35.298456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:35.326495 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-56d42abc-a065-4548-8ec1-6d087be2f716 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040817 Nov 22 13:46:35.327642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 230/490] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:46:35 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:46:35.518591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:35.519204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:35.525483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:35.525936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:35.526714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:35.527153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:35.657788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:35.665628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b950af49-cf48-424b-9e66-eb03e4bdc36e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.151242 Nov 22 13:46:35.666193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 261/491] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:35 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:36.520761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:36.521285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:36.528032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.528486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.529292 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.529732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.556996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:46:36.641999 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-37509d8f-e8d6-4ad5-864d-a61bb080d03c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 204 len: 0 microversion: 2.1 time: 0.125001 Nov 22 13:46:36.642876 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 231/492] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:46:36 2021] DELETE /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:46:36.651582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:36.652951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:36.663164 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.663938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.667027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.667027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.684565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:36.685481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:36.692864 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.693473 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.694626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:36.695152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:36.852831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:36.859244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:36.870678 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-78af72b3-53e1-451d-ba9e-1e6f8f5670d1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.190382 Nov 22 13:46:36.871297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a9c2423b-71d9-4f5f-b255-5f86ff230a8e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1514 microversion: 2.1 time: 0.223526 Nov 22 13:46:36.880468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 232/493] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:36 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:36.881619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 262/494] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:36 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:37.768197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cc6baf8-735a-4433-8572-3495a4f473cc", "device": "/dev/sdb"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:37.769836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:37.777086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:37.777851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:37.778818 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:37.779410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:37.887753 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:37.888450 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:37.895850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:37.896322 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:37.897337 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:37.897774 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:38.063865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:38.074493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-294bb0d2-ef09-46b5-8061-8a791172362a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.190494 Nov 22 13:46:38.078404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0fca69e1-37e8-47eb-8089-713256836398 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "POST /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313813 Nov 22 13:46:38.079386 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 233/495] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:46:37 2021] POST /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:38.085565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:38.086286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:38.092664 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:38.093833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:38.094928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:38.095424 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:38.105324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 263/496] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:37 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:38.282920 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:38.291128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2362de8a-281c-4199-bb77-047e6c863b5f tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1514 microversion: 2.1 time: 0.210609 Nov 22 13:46:38.291902 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 234/497] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:38 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:39.097895 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:39.098709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:39.105137 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:39.105763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:39.106785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:39.107231 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:39.256583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:39.266341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e3e8b1ad-9fc9-48a3-9c0d-fa0bf068bb5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.171261 Nov 22 13:46:39.268215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 264/498] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:39 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:39.310982 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:39.311796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:39.318183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:39.318760 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:39.319573 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:39.320012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:39.461737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:39.471988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6daa83c8-b282-4734-9480-00af2468281a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1514 microversion: 2.1 time: 0.164585 Nov 22 13:46:39.472872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 235/499] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:39 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:40.284932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:40.286442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:40.306615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:40.307521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:40.308937 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:40.311531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:40.491636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:40.492333 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:40.513856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:40.516644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:40.521854 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:40.524425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:40.642875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:40.649951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:40.658840 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-06f3aeed-c02f-425e-bb12-c932ea9fa6e6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 200 len: 1472 microversion: 2.1 time: 0.170818 Nov 22 13:46:40.661931 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-59fe1f08-0cf6-4c21-b387-0b7e122a1199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.380631 Nov 22 13:46:40.671409 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 236/500] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:40 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:40.673404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 265/501] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:40 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:40.677376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-00c407d2-848e-43df-9bdb-eed5435ee56e req-e0000410-fa7e-4c88-a5b0-2191a8bf33c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc1627d-2a2c-4ac6-b832-9ab05b4da015", "name": "network-vif-deleted", "tag": "38144404-1539-410c-a098-200cd008d0f8"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:40.679082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:40.679082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:40.688653 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-00c407d2-848e-43df-9bdb-eed5435ee56e req-e0000410-fa7e-4c88-a5b0-2191a8bf33c9 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:40.689093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-00c407d2-848e-43df-9bdb-eed5435ee56e req-e0000410-fa7e-4c88-a5b0-2191a8bf33c9 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:40.700947 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-00c407d2-848e-43df-9bdb-eed5435ee56e req-e0000410-fa7e-4c88-a5b0-2191a8bf33c9 service nova] Creating event network-vif-deleted:38144404-1539-410c-a098-200cd008d0f8 for instance 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 on hv-cinder-76845 Nov 22 13:46:40.707077 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-00c407d2-848e-43df-9bdb-eed5435ee56e req-e0000410-fa7e-4c88-a5b0-2191a8bf33c9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034120 Nov 22 13:46:40.707674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 237/502] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:41.678768 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:41.679418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 5bc1627d-2a2c-4ac6-b832-9ab05b4da015] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:41.680716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:41.681445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:41.685707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:41.686740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:41.687607 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:41.687938 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:41.688066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:41.688388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:41.689173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:41.689636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:41.700880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Instance 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 could not be found. Nov 22 13:46:41.701495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 404 to user: Instance 5bc1627d-2a2c-4ac6-b832-9ab05b4da015 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:46:41.702833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b5f25e58-98c0-40b6-b5e8-badbb03cec46 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015" status: 404 len: 111 microversion: 2.1 time: 0.027847 Nov 22 13:46:41.703377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 266/503] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:41 2021] GET /compute/v2.1/servers/5bc1627d-2a2c-4ac6-b832-9ab05b4da015 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:46:41.893390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:41.902254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1953bb35-5152-4c95-bcee-6f591ffcbcb2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.225922 Nov 22 13:46:41.903079 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 238/504] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:41 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:42.871772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:42.872959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:42.880351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:42.880800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:42.881611 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:42.882218 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:42.909037 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:46:42.919884 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:42.921868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:42.931990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:42.932413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:42.933419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:42.934021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:43.004327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9316ca0b-57cb-47dc-84c7-0f0de9554cbd tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 204 len: 0 microversion: 2.1 time: 0.134986 Nov 22 13:46:43.008871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 267/505] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:46:42 2021] DELETE /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:46:43.016640 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:43.017877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:43.026852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:43.027307 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:43.028115 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:43.028584 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:43.134684 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:43.144631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b6406dde-0376-4e20-a727-6e82a8d4e3c4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.228685 Nov 22 13:46:43.153239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 239/506] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:42 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:43.207720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:43.215814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0e7b2a70-b250-43ae-8e54-4b89217311fa tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1513 microversion: 2.1 time: 0.205478 Nov 22 13:46:43.226319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 268/507] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:43 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:44.167302 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:44.167938 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:44.175432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:44.176600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:44.177499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:44.177940 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:44.233969 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:44.235406 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:44.242548 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:44.243308 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:44.244557 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:44.245000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:44.351167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:44.361281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b4cde00b-a809-482e-aac3-01187b7260a3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.198031 Nov 22 13:46:44.375464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 240/508] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:44 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:44.420304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:44.430376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2ec75259-c328-48ae-bbad-a9347a78a600 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1513 microversion: 2.1 time: 0.199528 Nov 22 13:46:44.430376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 269/509] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:44 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:45.378364 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:45.378997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:45.385494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:45.386195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:45.386964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:45.387575 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:45.446928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:45.447530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:45.458342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:45.458800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:45.459657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:45.460264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:45.571000 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:45.579749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7a6be231-5ca2-42ba-8530-7bb720b44253 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.205136 Nov 22 13:46:45.581657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 241/510] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:45 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:45.659293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:45.671726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c02efc92-2316-48c3-aeeb-f3a3f98672b2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1513 microversion: 2.1 time: 0.227185 Nov 22 13:46:45.672866 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 270/511] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:45 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:46.599026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:46.600202 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:46.607145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:46.607816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:46.609076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:46.609708 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:46.691050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:46.691680 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:46.703974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:46.704685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:46.705506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:46.705945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:46.787146 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:46.801459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-833f0237-a13d-40f5-9f3c-d4242c807735 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.206003 Nov 22 13:46:46.812565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 242/512] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:46 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:46.988549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:46.995873 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-99668090-1ef3-4123-a8f9-21066e9f9d3d tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1513 microversion: 2.1 time: 0.308393 Nov 22 13:46:46.996747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 271/513] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:46 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:47.436474 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-380df17e-0a75-4a0f-b11b-631db542b0d2 req-c48cb1f7-d694-4ab7-b8a8-da5a1195f56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f49825-783b-4991-9213-98c29527695e", "name": "network-vif-deleted", "tag": "a760b18b-7299-4bf4-8bbf-18fad93e8b12"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:46:47.444357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:46:47.444357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:46:47.459714 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-380df17e-0a75-4a0f-b11b-631db542b0d2 req-c48cb1f7-d694-4ab7-b8a8-da5a1195f56a service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:47.460357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-380df17e-0a75-4a0f-b11b-631db542b0d2 req-c48cb1f7-d694-4ab7-b8a8-da5a1195f56a service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:47.483728 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-380df17e-0a75-4a0f-b11b-631db542b0d2 req-c48cb1f7-d694-4ab7-b8a8-da5a1195f56a service nova] Creating event network-vif-deleted:a760b18b-7299-4bf4-8bbf-18fad93e8b12 for instance 16f49825-783b-4991-9213-98c29527695e on hv-cinder-76845 Nov 22 13:46:47.490121 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-380df17e-0a75-4a0f-b11b-631db542b0d2 req-c48cb1f7-d694-4ab7-b8a8-da5a1195f56a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057753 Nov 22 13:46:47.491300 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 243/514] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:46:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:46:47.819628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:47.820243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:47.827551 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:47.828007 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:47.828788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:47.829449 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:47.975011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:47.985237 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-71363f79-3972-495b-ab3e-e168b73c6da0 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.169459 Nov 22 13:46:47.993559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 272/515] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:47 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:48.014092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:48.014934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:48.021527 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:48.022362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:48.023384 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:48.024057 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:48.087414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:48.094860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-76fdc12a-e286-4ecc-8654-c95b46df0bb4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1471 microversion: 2.1 time: 0.084946 Nov 22 13:46:48.095745 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 244/516] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:48 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:49.002332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:49.003257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:49.010621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:49.011073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:49.012064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:49.012502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:49.113014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:49.113791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:49.122255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:49.122859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:49.124704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:49.125563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:49.192008 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:49.200272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b3688e67-0910-4aac-8110-c0a186d0aa1a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.201950 Nov 22 13:46:49.200486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:49.203303 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 273/517] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:48 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:49.211383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-239acf77-1679-43d4-8092-4123dae58fed tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1471 microversion: 2.1 time: 0.102681 Nov 22 13:46:49.212418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 245/518] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:49 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1471 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:50.219130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:50.219749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:50.226434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:50.226883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:50.227927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:50.228592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:50.234240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:50.234778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:50.242875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:50.243877 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:50.245153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:50.245789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:50.347482 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:50.358574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4c7a679f-4b32-43c2-89eb-f462a52576c6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1302 microversion: 2.1 time: 0.130350 Nov 22 13:46:50.370984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 246/519] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:50 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:50.382559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:50.392573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-85735266-1758-4b72-9061-424e92c3bce1 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.177231 Nov 22 13:46:50.393594 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 274/520] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:50 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:51.380079 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:51.380690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:51.387180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:51.387690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:51.388475 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:51.389007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:51.412023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:51.413318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:51.420787 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:51.421912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:51.422818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:51.423267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:51.424099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:51.424569 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:51.425003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'fault' on Instance uuid 16f49825-783b-4991-9213-98c29527695e {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:46:51.470528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:51.481961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9a201ba2-28e9-4ebf-a8df-21d7633fd81a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 200 len: 1307 microversion: 2.1 time: 0.105699 Nov 22 13:46:51.483545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 247/521] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:51 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:51.582112 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:51.598267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-74d84031-ac0c-4321-9b10-670bc82afce5 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.190881 Nov 22 13:46:51.611270 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 275/522] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:51 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:52.506984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:52.509592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: 16f49825-783b-4991-9213-98c29527695e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:52.523899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.524343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.527398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.528055 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.551015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Instance 16f49825-783b-4991-9213-98c29527695e could not be found. Nov 22 13:46:52.551605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 404 to user: Instance 16f49825-783b-4991-9213-98c29527695e could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:46:52.552453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a40c527a-0b3b-48f0-9f42-32cce934e4b7 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e" status: 404 len: 111 microversion: 2.1 time: 0.056074 Nov 22 13:46:52.553346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 248/523] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:52 2021] GET /compute/v2.1/servers/16f49825-783b-4991-9213-98c29527695e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:46:52.563014 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:52.564638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:52.573521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.574037 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.574955 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.575821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.604663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:46:52.618584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:52.619224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:52.631171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.632221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.633594 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.634263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.741448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e7098ce8-bc5c-47a7-9df5-80f3fc5da4ff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 204 len: 0 microversion: 2.1 time: 0.182843 Nov 22 13:46:52.742780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 276/524] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:46:52 2021] DELETE /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:46:52.758032 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:52.761984 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:52.774456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.774911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.776922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:52.777401 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:52.822363 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:52.831441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7eba7444-5091-4dfe-8e36-307fdf913ffb tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.216541 Nov 22 13:46:52.833697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 249/525] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:52 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:52.935500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:52.949106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cdf41367-922d-4918-8c7f-efb9e8f39848 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.199573 Nov 22 13:46:52.950109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 277/526] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:52 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:53.851617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:53.852163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:53.859383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:53.859839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:53.860636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:53.861075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:53.968413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:53.969122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:53.975423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:53.975869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:53.976649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:53.977078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:53.996058 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:54.004266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fc70483c-48aa-43fb-8e0c-3f141318d956 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.156352 Nov 22 13:46:54.004841 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 250/527] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:53 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:54.106909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:54.114880 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f644ce7d-79d9-4501-a652-89990a0c280c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.151031 Nov 22 13:46:54.115438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 278/528] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:53 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:55.020916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:55.021766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:55.028028 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:55.028484 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:55.029835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:55.030436 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:55.131686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:55.132359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:55.139118 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:55.139580 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:55.140391 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:55.140822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:55.170379 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:55.178326 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-116902b9-8ded-4106-b6de-2317d8feece3 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.161015 Nov 22 13:46:55.178899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 251/529] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:55 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:55.276550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:55.283791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c84e56bc-37ea-405a-bb40-51be5f504494 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.156014 Nov 22 13:46:55.284352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 279/530] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:55 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:56.196883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:56.197520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:56.206935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:56.207383 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:56.208186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:56.209529 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:56.303953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:56.305693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:56.318228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:56.319364 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:56.320696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:56.321716 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:56.360669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:56.368938 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-52549252-30bb-4ac5-98dc-d47091ced91f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.176757 Nov 22 13:46:56.369565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 252/531] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:56 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:56.500710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:56.515850 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-25b7a117-be9c-464d-98c8-04a4d7f02cde tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.217805 Nov 22 13:46:56.516608 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 280/532] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:56 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:57.386969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:57.387589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:57.395739 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:57.396597 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:57.403871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:57.405049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:57.533750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:57.535445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:57.543266 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:57.544116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:57.545456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:57.546146 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:57.573443 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:57.620542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-769c0ea4-90da-4b37-b840-77f1fa4e8bbe tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.237213 Nov 22 13:46:57.621887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 253/533] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:57 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:57.702605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:57.710819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-182a8e87-5eb1-4290-acc7-d33023be2a36 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.181372 Nov 22 13:46:57.712027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 281/534] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:57 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:58.637732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:58.638341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:58.644893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:58.645381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:58.646159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:58.646599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:58.729300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:58.729812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:58.736809 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:58.737292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:58.738079 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:58.738519 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:58.782649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:58.790446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8a415c65-bdac-47c2-9dc9-8b33e88a08dd tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.156340 Nov 22 13:46:58.791010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 254/535] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:58 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:46:58.886377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:58.894835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-11580e5a-4ba9-4ada-8dd2-9fc9234f2ad3 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.169458 Nov 22 13:46:58.895416 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 282/536] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:58 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:46:59.807369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:59.807983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:59.814047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:59.814501 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:59.815279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:59.815753 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:59.912471 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:46:59.913082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:46:59.919326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:59.919780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:59.920571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:46:59.921011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:46:59.949919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:46:59.958616 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-33ddb152-9849-4bde-ad01-da255e42c9be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.154764 Nov 22 13:46:59.959198 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 255/537] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:59 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:00.050311 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:00.057451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-39ac1aed-c9bc-42af-bd0e-05dc8293821e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.148807 Nov 22 13:47:00.058005 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 283/538] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:46:59 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:00.975871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:00.976512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:00.983492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:00.983940 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:00.984722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:00.985161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:01.075098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:01.075825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:01.083267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:01.083726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:01.084524 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:01.084974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:01.116868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:01.124780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-707691c6-d02d-4981-ba89-5bc0a58c0e59 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.152502 Nov 22 13:47:01.125447 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 256/539] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:00 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:01.217693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:01.224822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fffbf927-55c4-4ddf-9d2c-2d056772903a tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.153366 Nov 22 13:47:01.225408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 284/540] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:01 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:02.141541 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:02.142153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:02.148643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:02.149095 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:02.149897 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:02.150360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:02.241784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:02.242396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:02.250029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:02.250488 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:02.251298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:02.251736 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:02.282102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:02.289894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80ee55f3-64b8-4650-a21c-3e1af88d8871 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.151850 Nov 22 13:47:02.290486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 257/541] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:02 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:02.391788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:02.399078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d2c2f04e-5321-4ead-9713-153e8f79cc8c tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1514 microversion: 2.1 time: 0.160990 Nov 22 13:47:02.399640 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 285/542] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:02 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:03.112425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-1628c886-4abd-421d-a2f2-861bfbda0e9b req-fb52f0da-f1e6-45e6-9b32-7909d676661c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2ef5de-febe-4a82-a6e4-39273ff76912", "name": "network-vif-deleted", "tag": "80f03947-781b-4a39-9323-dfa2732c6802"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:03.114073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:03.114073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:47:03.125056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-1628c886-4abd-421d-a2f2-861bfbda0e9b req-fb52f0da-f1e6-45e6-9b32-7909d676661c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.125593 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-1628c886-4abd-421d-a2f2-861bfbda0e9b req-fb52f0da-f1e6-45e6-9b32-7909d676661c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.139196 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-1628c886-4abd-421d-a2f2-861bfbda0e9b req-fb52f0da-f1e6-45e6-9b32-7909d676661c service nova] Creating event network-vif-deleted:80f03947-781b-4a39-9323-dfa2732c6802 for instance ec2ef5de-febe-4a82-a6e4-39273ff76912 on hv-cinder-76845 Nov 22 13:47:03.144564 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-1628c886-4abd-421d-a2f2-861bfbda0e9b req-fb52f0da-f1e6-45e6-9b32-7909d676661c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Nov 22 13:47:03.145217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 258/543] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:03.307017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:03.307625 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:03.314120 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.314567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.315342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.315776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.416518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:03.417228 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:03.423781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.424227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.425011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.425464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.458659 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:03.459110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:03.459761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'fault' on Instance uuid ec2ef5de-febe-4a82-a6e4-39273ff76912 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:03.502450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:03.504405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:03.512066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6198f0eb-7cf9-4811-9f43-ab231c99a0d6 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 200 len: 1308 microversion: 2.1 time: 0.099804 Nov 22 13:47:03.512225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0ee71f2c-b479-4b0b-bdac-003e823c8f11 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.208805 Nov 22 13:47:03.512644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 286/545] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:03 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:03.512787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 259/545] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:03 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:04.529819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:04.530504 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:04.530863 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:04.530958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: ec2ef5de-febe-4a82-a6e4-39273ff76912] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:04.537023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:04.537186 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:04.537411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:04.537530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:04.538206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:04.538307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:04.538650 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:04.538761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:04.551496 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Instance ec2ef5de-febe-4a82-a6e4-39273ff76912 could not be found. Nov 22 13:47:04.552087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 404 to user: Instance ec2ef5de-febe-4a82-a6e4-39273ff76912 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:04.552907 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2ba57665-6e58-45a9-abf5-31451ecfcb6e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912" status: 404 len: 111 microversion: 2.1 time: 0.026716 Nov 22 13:47:04.553488 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 287/546] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:04 2021] GET /compute/v2.1/servers/ec2ef5de-febe-4a82-a6e4-39273ff76912 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 13:47:04.681008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:04.688980 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6fc02d3a-986f-4e31-9b9f-7ad579acc738 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1566 microversion: 2.1 time: 0.163082 Nov 22 13:47:04.689588 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 260/547] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:04 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:05.684012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:05.684723 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:05.690926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.691372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.692157 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.692594 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.707435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:05.708060 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:05.714592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.715228 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.716227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.717239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.726962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:47:05.816922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-97e286f1-c8f5-47b2-96d9-cba9f8ba347b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 204 len: 0 microversion: 2.1 time: 0.136063 Nov 22 13:47:05.817906 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 288/548] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:05 2021] DELETE /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:47:05.827490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:05.828197 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:05.835340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.835799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.836600 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.837048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.864755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:05.876410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b630b1f5-5539-4831-8c15-ff601969f121 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1546 microversion: 2.1 time: 0.171249 Nov 22 13:47:05.876987 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 261/549] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:05 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:05.895056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:05.895549 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:05.901358 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.902034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.902951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:05.903379 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:05.992993 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:05.995266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] HTTP exception thrown: Cannot 'detach_volume' instance 067f06e1-5203-4223-bdb1-f364f84ccaaa while it is in vm_state rescued Nov 22 13:47:05.995871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Returning 409 to user: Cannot 'detach_volume' instance 067f06e1-5203-4223-bdb1-f364f84ccaaa while it is in vm_state rescued {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:05.996747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2b86dbe8-1e4a-43c5-a4e9-deed89aa9332 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments/f2b342ae-9813-4ab3-9fca-4354527f0dd1" status: 409 len: 152 microversion: 2.1 time: 0.105616 Nov 22 13:47:05.997324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 262/550] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:47:05 2021] DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments/f2b342ae-9813-4ab3-9fca-4354527f0dd1 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 22 13:47:06.006462 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4820a95a-b514-432b-b480-3013b6990cff tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1512 microversion: 2.1 time: 0.183768 Nov 22 13:47:06.010094 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:06.010894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:06.016480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 289/551] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:05 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:06.017179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:06.017837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:06.018629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:06.019218 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:06.090220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3df037a7-1ea6-47bf-a7be-af7e9ebab104 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action" status: 202 len: 0 microversion: 2.1 time: 0.085460 Nov 22 13:47:06.090903 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 263/552] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:47:06 2021] POST /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:47:06.099485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:06.100275 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:06.106831 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:06.107465 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:06.108436 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:06.109033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:06.354388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:06.364247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-76662dec-a1fa-4e5b-a6e3-5f6e8177f43e tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1554 microversion: 2.1 time: 0.268690 Nov 22 13:47:06.366231 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 290/553] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:06 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:07.024011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:07.024719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:07.032307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.032757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.033574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.034012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.196246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:07.204880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-67e84432-4200-46df-8c48-8eb837acd3c2 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1512 microversion: 2.1 time: 0.185430 Nov 22 13:47:07.205663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 264/554] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:07 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:07.251654 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:07.252222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:07.259555 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.259917 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.260698 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.261323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.354752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lazy-loading 'services' on Instance uuid 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:07.383003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:07.384168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:07.394131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.394646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.395457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:07.395898 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:07.455411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4ea026a5-01be-461a-8cc2-09a8b991f857 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c/os-volume_attachments/4cc6baf8-735a-4433-8572-3495a4f473cc" status: 202 len: 0 microversion: 2.1 time: 0.208155 Nov 22 13:47:07.456254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 291/555] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:47:07 2021] DELETE /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c/os-volume_attachments/4cc6baf8-735a-4433-8572-3495a4f473cc => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:47:07.588216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:07.597221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-361ea9d7-0b5a-4690-9996-cacb1bf739ce tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1554 microversion: 2.1 time: 0.217956 Nov 22 13:47:07.598106 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 265/556] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:07 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:08.223430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:08.224246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:08.230539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:08.231069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:08.232487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:08.233436 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:08.424332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:08.436235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f97f3963-78bd-44eb-9aba-a8f856ebb2e4 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1512 microversion: 2.1 time: 0.215864 Nov 22 13:47:08.436824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 292/557] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:08 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:08.475956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:47:08.476742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: Mon Nov 22 13:47:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:47:08.614253 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:08.614787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:08.620903 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:08.621388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:08.622162 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:08.622762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:08.840491 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:08.849584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c8275de4-bb57-4430-a101-4952226f9b0f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1554 microversion: 2.1 time: 0.238967 Nov 22 13:47:08.850682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 266/558] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:08 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:09.453376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:09.453983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:09.460106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:09.460695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:09.461656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:09.462043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:09.671843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:09.679390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b74c4886-bb40-425c-a28d-7c94c8a3390e tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1512 microversion: 2.1 time: 0.230147 Nov 22 13:47:09.679971 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 293/559] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:09 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:09.867647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:09.868255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:09.875174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:09.875621 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:09.876403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:09.876832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:10.098542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:10.111615 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8844b716-df58-41aa-80a0-2bdbc9ebfc9a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1554 microversion: 2.1 time: 0.247609 Nov 22 13:47:10.122090 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 267/560] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:09 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:10.700233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:10.702891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:10.710203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:10.710940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:10.712517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:10.713152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:11.130820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:11.131425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:11.137992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:11.138435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:11.139449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:11.139980 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:11.282928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:11.293419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9c0589cc-5934-460b-926d-b4748519cc5f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1554 microversion: 2.1 time: 0.166847 Nov 22 13:47:11.294052 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 268/561] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:11 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:11.354898 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:11.365802 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8cf149eb-a0c6-43ab-94dc-1aee6e79db4b tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1512 microversion: 2.1 time: 0.669607 Nov 22 13:47:11.366368 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 294/562] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:10 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1512 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:11.853891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:11.854667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:11.862030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:11.862750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:11.863985 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:11.864725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:11.951756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:47:12.034709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-fde7f030-a131-4a57-9bb8-f9e534f2d64c req-2fc57e14-a063-4aee-9beb-902733f7d663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc23c4cb-5e26-4a3f-83a2-3f73820458a7", "name": "network-vif-deleted", "tag": "50c3ed50-5520-48a4-93ea-11a9469b0a4f"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:12.036647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:12.036647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:12.043956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-fde7f030-a131-4a57-9bb8-f9e534f2d64c req-2fc57e14-a063-4aee-9beb-902733f7d663 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.045216 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-fde7f030-a131-4a57-9bb8-f9e534f2d64c req-2fc57e14-a063-4aee-9beb-902733f7d663 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.064346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4d9fb889-4213-4fea-a777-69036b7ad1e8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 204 len: 0 microversion: 2.1 time: 0.213332 Nov 22 13:47:12.066464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 269/563] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:11 2021] DELETE /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:47:12.073340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-fde7f030-a131-4a57-9bb8-f9e534f2d64c req-2fc57e14-a063-4aee-9beb-902733f7d663 service nova] Creating event network-vif-deleted:50c3ed50-5520-48a4-93ea-11a9469b0a4f for instance fc23c4cb-5e26-4a3f-83a2-3f73820458a7 on hv-cinder-76845 Nov 22 13:47:12.080531 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:12.081687 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:12.090568 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-fde7f030-a131-4a57-9bb8-f9e534f2d64c req-2fc57e14-a063-4aee-9beb-902733f7d663 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059026 Nov 22 13:47:12.092284 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 295/564] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:12.096551 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.098057 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.099978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.100704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.312543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:12.313470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:12.314549 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:12.324618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f1243912-dc43-4205-8ceb-d18c53d4a2ef tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1513 microversion: 2.1 time: 0.253927 Nov 22 13:47:12.325605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.326218 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 270/565] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:12 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:12.326392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.327330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.327779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.396221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:12.397153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:12.422503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.423107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.423986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.424497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.472047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.472503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.472957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lazy-loading 'fault' on Instance uuid fc23c4cb-5e26-4a3f-83a2-3f73820458a7 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:12.519453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcfdb2c09693488588c0a7b1232739e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dd94dbfdb43e48d2ed35368bd14a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:12.529108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2d531bcd-081d-4f44-bf9d-bf6a37390230 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 200 len: 1307 microversion: 2.1 time: 0.148413 Nov 22 13:47:12.530368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 271/566] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:12 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:12.612204 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:12.624200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-44d246cb-d90b-4079-9970-8b2c02993485 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1560 microversion: 2.1 time: 0.315837 Nov 22 13:47:12.624603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 296/567] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:12 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1560 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:12.703004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:12.703500 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:12.714346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.714933 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.715730 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.716200 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.817738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'services' on Instance uuid 067f06e1-5203-4223-bdb1-f364f84ccaaa {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:12.894428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f4632b93-016a-4537-ae88-d048e2bb50be tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments/f2b342ae-9813-4ab3-9fca-4354527f0dd1" status: 202 len: 0 microversion: 2.1 time: 0.195652 Nov 22 13:47:12.895464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 272/568] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:47:12 2021] DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments/f2b342ae-9813-4ab3-9fca-4354527f0dd1 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:47:12.903240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:12.904715 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:12.913385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.913844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.914647 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:12.915081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:12.954667 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1d318ea6-81d5-4c0d-930c-3fd326ae0a6a tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055130 Nov 22 13:47:12.955598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 297/569] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:47:12 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:13.344164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:13.344961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:13.351299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.351829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:13.352704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.353404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:13.517135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:13.524539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3cb71ea6-814e-406f-9159-c9ec782275f1 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1513 microversion: 2.1 time: 0.185917 Nov 22 13:47:13.534497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 273/570] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:13 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:13.546379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:13.546999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] [instance: fc23c4cb-5e26-4a3f-83a2-3f73820458a7] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:13.553623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.554086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:13.555073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.555516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:13.569282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] HTTP exception thrown: Instance fc23c4cb-5e26-4a3f-83a2-3f73820458a7 could not be found. Nov 22 13:47:13.569889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] Returning 404 to user: Instance fc23c4cb-5e26-4a3f-83a2-3f73820458a7 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:13.570742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7dd53431-cf47-4fa6-af42-e48cdba731e8 tempest-AttachVolumeNegativeTest-1604538604 tempest-AttachVolumeNegativeTest-1604538604-project] 10.222.0.31 "GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7" status: 404 len: 111 microversion: 2.1 time: 0.028058 Nov 22 13:47:13.571487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 298/571] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:13 2021] GET /compute/v2.1/servers/fc23c4cb-5e26-4a3f-83a2-3f73820458a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:47:13.968488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:13.969713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:13.976908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.977528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:13.980791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:13.981673 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:14.019462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f6ebe340-318a-4c8e-8cad-066c26451e2f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055444 Nov 22 13:47:14.020979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 274/572] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:47:13 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:47:14.541579 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:14.542187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:14.549028 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:14.550209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:14.551171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:14.551785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:14.846786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:14.855012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-070d4edc-81b4-4d8d-8956-985ca35c0ff9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 200 len: 1513 microversion: 2.1 time: 0.316926 Nov 22 13:47:14.855609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 299/573] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:14 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:15.065688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-73eabb53-54d0-4599-be1d-b3ddb25139af req-92ed405e-c568-4ccd-a9a7-e1c34b79c325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f43fb42-29e7-4162-a4a2-4f4d6f790d7c", "name": "network-vif-deleted", "tag": "2d483769-a043-4eb0-92ac-80f96ec6440c"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:15.071326 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:15.071326 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:47:15.082855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-73eabb53-54d0-4599-be1d-b3ddb25139af req-92ed405e-c568-4ccd-a9a7-e1c34b79c325 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:15.084455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-73eabb53-54d0-4599-be1d-b3ddb25139af req-92ed405e-c568-4ccd-a9a7-e1c34b79c325 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:15.102263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-73eabb53-54d0-4599-be1d-b3ddb25139af req-92ed405e-c568-4ccd-a9a7-e1c34b79c325 service nova] Creating event network-vif-deleted:2d483769-a043-4eb0-92ac-80f96ec6440c for instance 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c on hv-cinder-76845 Nov 22 13:47:15.110203 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-73eabb53-54d0-4599-be1d-b3ddb25139af req-92ed405e-c568-4ccd-a9a7-e1c34b79c325 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056251 Nov 22 13:47:15.111809 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 275/574] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:15.874409 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:15.875129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:15.886137 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:15.889041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:15.890394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:15.892132 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:15.912302 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] HTTP exception thrown: Instance 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c could not be found. Nov 22 13:47:15.924077 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Returning 404 to user: Instance 9f43fb42-29e7-4162-a4a2-4f4d6f790d7c could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:15.926784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-998881ac-33d3-45dd-8562-9d87d98670d5 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c" status: 404 len: 111 microversion: 2.1 time: 0.056919 Nov 22 13:47:15.930980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 300/575] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:15 2021] GET /compute/v2.1/servers/9f43fb42-29e7-4162-a4a2-4f4d6f790d7c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:47:16.557390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:16.557991 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:16.570305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:16.570758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:16.571572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:16.572018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:16.617037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:47:16.761086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-abcadec6-b246-433a-8546-b41c37b13b39 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "DELETE /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 204 len: 0 microversion: 2.1 time: 0.207860 Nov 22 13:47:16.766649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 276/576] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:16 2021] DELETE /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:47:16.776443 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:16.777414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:16.789675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:16.793101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:16.794586 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:16.795027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:16.993427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:17.003997 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-336bfb3c-bf55-44ab-b0b5-7433378ee99f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.231006 Nov 22 13:47:17.005334 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 301/577] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:16 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:18.023992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:18.025435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:18.051059 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:18.052354 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:18.053843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:18.055599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:18.436861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:18.449934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f3a771e9-d3c3-4cc5-b2ee-ea4c4166e114 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.427514 Nov 22 13:47:18.452574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 277/578] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:18 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:19.467539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:19.468165 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:19.479748 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:19.480236 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:19.481013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:19.487292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:20.159614 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:20.169317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1e865867-ac2c-4127-afbb-f67b1a534a01 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.705268 Nov 22 13:47:20.171359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 302/579] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:19 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:21.020127 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Action: 'create', calling method: .version_select at 0x7f673dbe73a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-717166159"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:21.033766 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for project ee3a9603fada4f72a111322a25c91454. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:21.037769 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for user 3abbc6b58dd44094a88ab8d4b4587935 and project ee3a9603fada4f72a111322a25c91454. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:21.152452 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-886253958", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:21.205559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] validate_networks() for None {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:47:21.336751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for project ee3a9603fada4f72a111322a25c91454. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:21.340371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for user 3abbc6b58dd44094a88ab8d4b4587935 and project ee3a9603fada4f72a111322a25c91454. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:21.355308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5642085a-47c3-4f62-9be3-f33557a41eb3 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.556475 Nov 22 13:47:21.355912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 278/580] 10.222.0.31 () {60 vars in 1157 bytes} [Mon Nov 22 13:47:20 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:21.361042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:21.361735 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:21.369007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:21.369503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:21.370297 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:21.370733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:21.526682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:47:21.527144 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:47:21.527633 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:47:21.529030 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:47:21.529966 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:47:21.539141 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:21.539988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:21.541010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:21.541662 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:21.559292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Getting quotas for project b9fdf43be88c43dea7f50cb3df0920eb. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:21.564448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Getting quotas for user 9ac350a0778b401aa0e8f8cf2e2fb22a and project b9fdf43be88c43dea7f50cb3df0920eb. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:21.577083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:47:21.579698 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:47:21.583727 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:21.591463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7dbcde0b-a5d6-4a18-9193-809ca12671ef tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.234126 Nov 22 13:47:21.592046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 279/581] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:21 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:21.655051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-205fa140-4d32-447e-a255-8b31703feeb8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506040 Nov 22 13:47:21.657157 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 303/582] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:47:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:47:21.667311 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-58d55634-342d-411d-a49a-f7722d625cc7 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:21.668167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-58d55634-342d-411d-a49a-f7722d625cc7 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:21.750590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-58d55634-342d-411d-a49a-f7722d625cc7 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:21.764782 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-58d55634-342d-411d-a49a-f7722d625cc7 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1214 microversion: 2.1 time: 0.099246 Nov 22 13:47:21.766665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 280/583] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:21 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:22.608704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:22.609352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:22.620662 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:22.622794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:22.623878 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:22.624508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:22.784391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:22.785245 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:22.811649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:22.812852 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:22.817483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:22.827240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:22.827741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:22.828768 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1cc85c58-c365-4912-a9ac-d37b7cb8e964 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.222334 Nov 22 13:47:22.832267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 304/584] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:22 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:22.913612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:22.927229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-24e8fee6-2a0c-4709-9937-7390f83ad955 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1218 microversion: 2.1 time: 0.147124 Nov 22 13:47:22.928131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 281/585] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:22 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:23.846357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:23.846969 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:23.853334 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:23.853786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:23.854564 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:23.855000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:23.948888 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:23.951186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:23.959322 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:23.960156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:23.961493 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:23.962195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:24.069763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:24.079514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:24.080664 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4a1dc6e9-ef07-474c-9069-80fb48ea52c2 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.238049 Nov 22 13:47:24.081356 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 305/586] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:23 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:24.092170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3452c80c-61b9-4404-8293-6d2004df1d2c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1218 microversion: 2.1 time: 0.149967 Nov 22 13:47:24.099858 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 282/587] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:23 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:25.097402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:25.098047 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:25.104918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.105613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.108111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.108525 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:25.109317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.110413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:25.119045 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.119736 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.120715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.121145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.190488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:25.198327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-81076e8c-b774-41ac-8607-5da856cfcca8 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1266 microversion: 2.1 time: 0.094319 Nov 22 13:47:25.198892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 283/588] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:25 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:25.203375 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-346654295", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "networks": [{"uuid": "74610957-0c8f-4be7-87b5-2b068bd616a7"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:25.250752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:25.257843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] validate_networks() for [('74610957-0c8f-4be7-87b5-2b068bd616a7', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:47:25.258644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3df7e1db-e0aa-4e75-83b8-fb784c06308f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.164946 Nov 22 13:47:25.259433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 306/589] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:25 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:25.618286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:47:25.618711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:47:25.619214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:47:25.619637 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:47:25.620051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:47:25.629357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.629802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.630612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:25.631046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:25.647492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Getting quotas for project 29a21fcc281743ddac3e5b53b5496a61. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:25.651336 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Getting quotas for user dc78f8e4f79641d390553bc5e1a954e3 and project 29a21fcc281743ddac3e5b53b5496a61. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:25.662228 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:47:25.664527 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:47:25.708104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2e132f01-301e-471a-affe-a2efcb669586 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508192 Nov 22 13:47:25.708751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 284/590] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:47:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:47:25.719717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ef158bb8-b60a-401d-adc7-0ff4a14b8ffe tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:25.720121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ef158bb8-b60a-401d-adc7-0ff4a14b8ffe tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:25.784010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ef158bb8-b60a-401d-adc7-0ff4a14b8ffe tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:25.790561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ef158bb8-b60a-401d-adc7-0ff4a14b8ffe tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1218 microversion: 2.1 time: 0.075627 Nov 22 13:47:25.791133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 307/591] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:25 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:26.215788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:26.216445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:26.222430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.222978 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.223770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.224217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.275636 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:26.276177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:26.282645 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.283098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.283885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.284327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.294290 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:26.301620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8bc9cc03-154d-49d0-b221-3664114aec5c tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1266 microversion: 2.1 time: 0.090105 Nov 22 13:47:26.302217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 285/592] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:26 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:26.426667 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:26.434011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7eb1dba0-b8e8-44b5-b497-590c7b3bc7e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.162125 Nov 22 13:47:26.435122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 308/593] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:26 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:26.807614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:26.808222 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:26.814794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.815241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.816014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:26.816443 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:26.880985 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:26.889828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4ee230fd-cab8-4b84-8f91-e14b648167d4 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1222 microversion: 2.1 time: 0.085762 Nov 22 13:47:26.890413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 286/594] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:26 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:27.319069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:27.319683 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:27.326906 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.327364 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.328176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.328615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.393823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:27.401532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0d5bd39a-6d57-4c5d-bac0-472a51d247fb tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1266 microversion: 2.1 time: 0.086156 Nov 22 13:47:27.402269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 309/595] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:27 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:27.452125 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:27.452748 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:27.459130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.459578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.460357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.460788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.600882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:27.616044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ee571b9d-7a16-40c4-8a09-a8ef44f1e35f tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1507 microversion: 2.1 time: 0.167996 Nov 22 13:47:27.616640 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 287/596] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:27 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:27.908772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:27.909429 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:27.918071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.919576 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.921621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.923206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:27.971284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-8a82f6aa-48d8-4e7e-99d9-8e16032acda5 req-db776c4d-de7e-4224-bcd9-9a69ff6a2352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03515ad0-4aa5-4b79-b17c-0182e9a89f98", "name": "network-vif-deleted", "tag": "f134f236-0d84-4ad1-ba73-313f831e4543"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:27.971284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:27.971284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:47:27.992670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-8a82f6aa-48d8-4e7e-99d9-8e16032acda5 req-db776c4d-de7e-4224-bcd9-9a69ff6a2352 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:27.993128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-8a82f6aa-48d8-4e7e-99d9-8e16032acda5 req-db776c4d-de7e-4224-bcd9-9a69ff6a2352 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.011067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-8a82f6aa-48d8-4e7e-99d9-8e16032acda5 req-db776c4d-de7e-4224-bcd9-9a69ff6a2352 service nova] Creating event network-vif-deleted:f134f236-0d84-4ad1-ba73-313f831e4543 for instance 03515ad0-4aa5-4b79-b17c-0182e9a89f98 on hv-cinder-76845 Nov 22 13:47:28.018626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-8a82f6aa-48d8-4e7e-99d9-8e16032acda5 req-db776c4d-de7e-4224-bcd9-9a69ff6a2352 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062392 Nov 22 13:47:28.019232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 288/597] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:28.050819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:28.066256 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-07c935d8-e981-4728-b89b-ac9d8af98c55 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1270 microversion: 2.1 time: 0.163304 Nov 22 13:47:28.080742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 310/598] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:27 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:28.423460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:28.425388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:28.436559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:28.437546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.438578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:28.440008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.571605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:28.582021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-87a44035-7845-457e-9978-ec10dd80c23b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1272 microversion: 2.1 time: 0.166724 Nov 22 13:47:28.582932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 289/599] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:28 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:28.641930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:28.643665 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:28.651515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:28.652447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.654233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:28.654937 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.706869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:28.707857 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:28.708894 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'fault' on Instance uuid 03515ad0-4aa5-4b79-b17c-0182e9a89f98 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:28.794536 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:28.804600 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-35a5cb1f-2c7a-429b-88c7-97c86b2d0c36 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 200 len: 1312 microversion: 2.1 time: 0.174414 Nov 22 13:47:28.805682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 311/600] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:28 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:29.088375 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:29.089303 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:29.099478 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.099934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.100733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.101166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.315747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:29.323011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f5f33499-565b-41a2-b136-1f5f0915b577 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.238990 Nov 22 13:47:29.323587 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 290/601] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:29 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:29.603058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:29.603956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:29.615124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.615900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.617108 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.617774 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.822034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:29.823268 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 03515ad0-4aa5-4b79-b17c-0182e9a89f98] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:29.831650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.832422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.833437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.835786 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.858127 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] HTTP exception thrown: Instance 03515ad0-4aa5-4b79-b17c-0182e9a89f98 could not be found. Nov 22 13:47:29.858988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Returning 404 to user: Instance 03515ad0-4aa5-4b79-b17c-0182e9a89f98 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:29.861579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fde15724-f532-4981-9bd6-d783a7b1d3a4 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98" status: 404 len: 111 microversion: 2.1 time: 0.043093 Nov 22 13:47:29.862637 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 291/602] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:29 2021] GET /compute/v2.1/servers/03515ad0-4aa5-4b79-b17c-0182e9a89f98 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 13:47:29.874026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:29.874859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:29.890450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.891267 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.892371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:29.893082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:29.910581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:29.931410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4d4ca418-c2ae-47aa-b5b3-8e213e71b7c2 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.333222 Nov 22 13:47:29.934603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 312/603] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:29 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:29.942137 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:47:30.070342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-30764d59-3d36-48cc-8b83-b6318a6b0d11 req-799dbe9c-755e-425d-abbf-5b656b1f3bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25377de6-d618-4294-876a-cafad05b1094", "tag": "b22da321-fcc3-409d-945d-68ec304289dc"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:30.072104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:30.072104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:30.073420 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e3a61228-6e61-44d2-9602-ecf3e06136e7 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 204 len: 0 microversion: 2.1 time: 0.205767 Nov 22 13:47:30.074547 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 292/604] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:29 2021] DELETE /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:47:30.084509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-30764d59-3d36-48cc-8b83-b6318a6b0d11 req-799dbe9c-755e-425d-abbf-5b656b1f3bd2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.086836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:30.087422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-30764d59-3d36-48cc-8b83-b6318a6b0d11 req-799dbe9c-755e-425d-abbf-5b656b1f3bd2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.088819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:30.096867 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.097362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.098767 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.099223 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.102962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-30764d59-3d36-48cc-8b83-b6318a6b0d11 req-799dbe9c-755e-425d-abbf-5b656b1f3bd2 service nova] Creating event network-changed:b22da321-fcc3-409d-945d-68ec304289dc for instance 25377de6-d618-4294-876a-cafad05b1094 on hv-cinder-76845 Nov 22 13:47:30.110639 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-30764d59-3d36-48cc-8b83-b6318a6b0d11 req-799dbe9c-755e-425d-abbf-5b656b1f3bd2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044246 Nov 22 13:47:30.111781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 313/605] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:47:30.116903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-6d3efc27-cc8c-44e3-83a3-e79bcd1797d2 req-945b6703-ed08-4020-8e65-84f6073936cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764d1f9a-5288-4aeb-8528-27eb8ad6958e", "tag": "e5ff694a-a0ea-43f2-a384-1fa878184012"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:30.125442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:30.125442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:30.145772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6d3efc27-cc8c-44e3-83a3-e79bcd1797d2 req-945b6703-ed08-4020-8e65-84f6073936cb service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.146407 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6d3efc27-cc8c-44e3-83a3-e79bcd1797d2 req-945b6703-ed08-4020-8e65-84f6073936cb service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.159062 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-6d3efc27-cc8c-44e3-83a3-e79bcd1797d2 req-945b6703-ed08-4020-8e65-84f6073936cb service nova] Creating event network-changed:e5ff694a-a0ea-43f2-a384-1fa878184012 for instance 764d1f9a-5288-4aeb-8528-27eb8ad6958e on hv-cinder-76845 Nov 22 13:47:30.171099 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-6d3efc27-cc8c-44e3-83a3-e79bcd1797d2 req-945b6703-ed08-4020-8e65-84f6073936cb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055150 Nov 22 13:47:30.171982 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 314/606] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:30.355173 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:30.355904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:30.362326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.363015 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.363808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.364251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.394713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:30.406995 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c2d935fa-3f76-48cb-ab9d-06b7fd6a3812 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.326790 Nov 22 13:47:30.407768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 293/607] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:30 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:30.575796 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:30.586955 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b3f136dd-5b4d-478e-8e26-51e5b14f8ed9 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.235895 Nov 22 13:47:30.587779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 315/608] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:30 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:30.952021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:30.953728 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:30.960873 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.961837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:30.963247 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:30.964066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:31.194118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:31.202520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-afd1bfdc-8776-476e-ac47-f1fb9a7e349e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.254820 Nov 22 13:47:31.203091 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 294/609] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:30 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:31.424804 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:31.425453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:31.432335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:31.432800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:31.433666 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:31.434681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:31.603674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:31.604313 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:31.612168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:31.612305 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:31.613034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:31.613867 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:31.614523 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:31.620669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7df4e499-a8c1-4b80-9756-827b1c7a6109 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.199695 Nov 22 13:47:31.630818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 316/610] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:31 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:31.769269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:31.776661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c869a73d-d1c8-481a-bf8b-5e7a3b247575 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.176678 Nov 22 13:47:31.777230 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 295/611] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:31 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:32.220481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:32.221127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:32.226897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.227353 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.228131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.228566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.383517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:32.391430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ab8c3b55-5d20-42cc-b980-4eb61c3d1dd3 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.174694 Nov 22 13:47:32.392009 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 317/612] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:32 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:32.638231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:32.638909 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:32.645440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.646007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.646933 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.647360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.662868 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:32.663427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:32.672110 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.685047 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.686364 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.686981 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.783803 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lazy-loading 'services' on Instance uuid 67bbd747-629b-485c-a1b2-e964b23cd5e6 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:32.826984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:32.836305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d7a5b3ea-5dd5-4054-a165-018991a51384 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.201809 Nov 22 13:47:32.836904 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 296/613] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:32 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:32.850960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:32.851509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:32.857622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.858081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.858876 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:32.859608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:32.883876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-14f8f743-4c9d-4562-9da6-c3d64c006f30 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments/02bd8530-82f4-4caf-a84d-660a90ece6e4" status: 202 len: 0 microversion: 2.1 time: 0.224295 Nov 22 13:47:32.885570 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 318/614] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:47:32 2021] DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments/02bd8530-82f4-4caf-a84d-660a90ece6e4 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:47:33.033628 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:33.042108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4feae7ce-a75a-48f0-aeb9-9bc9debe357c tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.194764 Nov 22 13:47:33.042900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 297/615] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:32 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:33.408758 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:33.409402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:33.415549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:33.415845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:33.416625 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:33.417051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:33.560605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:33.567861 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4b476858-d303-412f-bfeb-28abebb5db63 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.163169 Nov 22 13:47:33.568430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 319/616] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:33 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:33.853632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:33.854432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:33.863031 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:33.863477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:33.864429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:33.864864 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.018110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:34.028369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-20fb3503-9c50-42d4-a61b-cebb58e081bc tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.177723 Nov 22 13:47:34.033831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 298/617] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:33 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:34.037849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-032da197-09fd-4862-9836-de65f88f52b6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:34.046946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-032da197-09fd-4862-9836-de65f88f52b6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.047476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-032da197-09fd-4862-9836-de65f88f52b6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.063057 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:34.064206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:34.071311 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.071774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.073032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.073913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.075633 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-032da197-09fd-4862-9836-de65f88f52b6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Going to try to stop instance {{(pid=122685) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 13:47:34.140679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-032da197-09fd-4862-9836-de65f88f52b6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.107013 Nov 22 13:47:34.140679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 320/618] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:47:34 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:47:34.160776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:34.161529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:34.169340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.170408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.172087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.172705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.269309 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:34.280227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-27d78c45-326f-4568-8e26-8977934cc982 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.223980 Nov 22 13:47:34.281065 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 299/619] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:34 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:34.354630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:34.362587 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-149c3efa-359f-4297-a4b3-cabd76158979 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.208705 Nov 22 13:47:34.363167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 321/620] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:34 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:34.584890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:34.585817 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:34.592777 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.593260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.594074 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:34.594517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:34.733877 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:34.741456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-48c033f9-1e34-4d4d-9259-6caedacacf12 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.160415 Nov 22 13:47:34.742133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 300/621] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:34 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:35.050479 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:35.051133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:35.057505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.057968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.058794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.059792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.243437 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:35.258212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3d3132f1-4839-4dd4-8792-89c67f3250ea tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.210508 Nov 22 13:47:35.259505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 322/622] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:35 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:35.296430 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:35.297291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:35.306463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.306913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.307707 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.308274 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.381329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:35.382071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:35.396728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.397558 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.398863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.400293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.482547 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:35.490736 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8924df56-5676-4fd4-bcad-1ceca336eb86 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.197856 Nov 22 13:47:35.491361 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 301/623] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:35 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:35.588750 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:35.597095 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b0805bb8-720d-4064-af03-ebff4abc4d45 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.220576 Nov 22 13:47:35.597794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 323/624] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:35 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:35.762711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:35.764284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:35.770975 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.771520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.772393 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:35.773134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:35.939638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:35.948500 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a24a8c15-7646-40d7-a0bb-7aad29752865 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.192452 Nov 22 13:47:35.953272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 302/625] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:35 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:36.127710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-9633a1fe-d9e8-4086-b6ec-2e13ce4e6a57 req-3b295b35-d16d-4712-9a66-e2c5bfd7d647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25377de6-d618-4294-876a-cafad05b1094", "name": "network-vif-plugged", "status": "completed", "tag": "b22da321-fcc3-409d-945d-68ec304289dc"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:36.130251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:36.130251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:36.139641 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9633a1fe-d9e8-4086-b6ec-2e13ce4e6a57 req-3b295b35-d16d-4712-9a66-e2c5bfd7d647 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.140445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9633a1fe-d9e8-4086-b6ec-2e13ce4e6a57 req-3b295b35-d16d-4712-9a66-e2c5bfd7d647 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.156002 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-9633a1fe-d9e8-4086-b6ec-2e13ce4e6a57 req-3b295b35-d16d-4712-9a66-e2c5bfd7d647 service nova] Creating event network-vif-plugged:b22da321-fcc3-409d-945d-68ec304289dc for instance 25377de6-d618-4294-876a-cafad05b1094 on hv-cinder-76845 Nov 22 13:47:36.161026 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-9633a1fe-d9e8-4086-b6ec-2e13ce4e6a57 req-3b295b35-d16d-4712-9a66-e2c5bfd7d647 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037199 Nov 22 13:47:36.162558 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 324/626] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:36.278369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:36.279239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:36.285772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.286330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.287227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.287768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.511606 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:36.512947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:36.520857 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.525644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.526605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.527222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.561519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:36.571173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f43d7dcf-3d55-445d-9ef6-acdf69e89106 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1520 microversion: 2.1 time: 0.296374 Nov 22 13:47:36.581986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 303/627] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:36 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:36.616023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:36.616725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:36.623867 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.624403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.625313 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.625842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.807054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:36.815512 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2036e473-6d72-42c3-9e35-6c4e46c785c8 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.203368 Nov 22 13:47:36.816099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 304/628] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:36 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:36.858003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:36.865399 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-741972e5-60b5-4a2f-a36b-964ee3d5d9f8 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1318 microversion: 2.1 time: 0.357751 Nov 22 13:47:36.866208 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 325/629] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:36 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:36.968318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:36.969280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:36.975677 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.976442 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:36.977681 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:36.978208 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.149630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:37.162829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7ea2a42c-c2c6-4672-8b8f-6464ee44bdb5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.197989 Nov 22 13:47:37.164381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 305/630] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:36 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:37.236764 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-9b7f06de-6adf-4874-8a59-d2da03b3a017 req-53baf93c-7679-4443-ae48-7867422f28cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067f06e1-5203-4223-bdb1-f364f84ccaaa", "name": "network-vif-deleted", "tag": "6c00e9e6-d2fc-4a41-934e-e62ab70abc05"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:37.239621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:37.239621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:37.248068 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9b7f06de-6adf-4874-8a59-d2da03b3a017 req-53baf93c-7679-4443-ae48-7867422f28cd service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.248519 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9b7f06de-6adf-4874-8a59-d2da03b3a017 req-53baf93c-7679-4443-ae48-7867422f28cd service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.270255 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-9b7f06de-6adf-4874-8a59-d2da03b3a017 req-53baf93c-7679-4443-ae48-7867422f28cd service nova] Creating event network-vif-deleted:6c00e9e6-d2fc-4a41-934e-e62ab70abc05 for instance 067f06e1-5203-4223-bdb1-f364f84ccaaa on hv-cinder-76845 Nov 22 13:47:37.275007 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-9b7f06de-6adf-4874-8a59-d2da03b3a017 req-53baf93c-7679-4443-ae48-7867422f28cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041912 Nov 22 13:47:37.275623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 326/631] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:37.590837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:37.591539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:37.598457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.598991 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.599952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.600548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.634477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.634931 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.635373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lazy-loading 'fault' on Instance uuid 067f06e1-5203-4223-bdb1-f364f84ccaaa {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:37.681597 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209b5f3e5c7f4ea7859e3c5c3e42e8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3623b6aa624b48b153f3bb831c6385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:37.690785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c46d49ac-941c-4659-9d14-af478cfb2bbf tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 200 len: 1311 microversion: 2.1 time: 0.103986 Nov 22 13:47:37.691591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 306/632] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:37 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:37.834999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:37.835723 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:37.842780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.843241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.844033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.844546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.883209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:37.883935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:37.890896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.891566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.892554 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:37.893148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:37.986403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:37.994043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d281ff79-6bdc-449f-afbf-c8f4ba8d8def tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.164459 Nov 22 13:47:38.004958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 327/633] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:37 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:38.034554 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:38.042173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3bc39a85-e4eb-438c-a7f0-4b8e08cbbf2e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1508 microversion: 2.1 time: 0.162493 Nov 22 13:47:38.042736 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 307/634] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:37 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:38.059550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df498f5-0b5a-474b-a559-66deac7f42c0", "device": "/dev/sdb"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:38.061433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:38.067184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.067654 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.068445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.068889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.180761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:38.181519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:38.188092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.188617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.189536 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.189936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.332657 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-70b83e5c-b131-4d00-82bd-875727e43280 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "POST /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277401 Nov 22 13:47:38.336100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:38.338126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 328/635] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:47:38 2021] POST /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:38.343877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-ea6e4ce5-aafe-4940-95d3-07534bf6d819 req-610048ac-fc30-4417-9d95-8692b66173a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764d1f9a-5288-4aeb-8528-27eb8ad6958e", "name": "network-vif-plugged", "status": "completed", "tag": "e5ff694a-a0ea-43f2-a384-1fa878184012"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:38.356475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:38.356475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:38.357154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a47c6a86-d3bd-4d8f-8628-1eaaaf0394e5 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.169353 Nov 22 13:47:38.357154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 308/636] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:38 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:38.363375 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-ea6e4ce5-aafe-4940-95d3-07534bf6d819 req-610048ac-fc30-4417-9d95-8692b66173a3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.363799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-ea6e4ce5-aafe-4940-95d3-07534bf6d819 req-610048ac-fc30-4417-9d95-8692b66173a3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.375002 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-ea6e4ce5-aafe-4940-95d3-07534bf6d819 req-610048ac-fc30-4417-9d95-8692b66173a3 service nova] Creating event network-vif-plugged:e5ff694a-a0ea-43f2-a384-1fa878184012 for instance 764d1f9a-5288-4aeb-8528-27eb8ad6958e on hv-cinder-76845 Nov 22 13:47:38.380017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-ea6e4ce5-aafe-4940-95d3-07534bf6d819 req-610048ac-fc30-4417-9d95-8692b66173a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Nov 22 13:47:38.380615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 329/637] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:38.707722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:38.709006 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] [instance: 067f06e1-5203-4223-bdb1-f364f84ccaaa] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:38.716760 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.717468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.718619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:38.719132 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:38.734448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] HTTP exception thrown: Instance 067f06e1-5203-4223-bdb1-f364f84ccaaa could not be found. Nov 22 13:47:38.735036 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] Returning 404 to user: Instance 067f06e1-5203-4223-bdb1-f364f84ccaaa could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:38.735862 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ba307670-8a48-4b2f-b36f-aa92b813a199 tempest-ServerRescueNegativeTestJSON-1463516326 tempest-ServerRescueNegativeTestJSON-1463516326-project] 10.222.0.31 "GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa" status: 404 len: 111 microversion: 2.1 time: 0.031976 Nov 22 13:47:38.736847 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 309/638] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:38 2021] GET /compute/v2.1/servers/067f06e1-5203-4223-bdb1-f364f84ccaaa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:47:39.013219 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:39.014109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:39.020796 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:39.021406 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:39.022296 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:39.022825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:39.243485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:39.251547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-186f0733-041a-4ec7-92ee-60c1f5d42f7c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.243492 Nov 22 13:47:39.252123 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 330/639] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:39 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:39.363598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:39.364189 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:39.370021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:39.370468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:39.371278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:39.371719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:39.509115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:39.517013 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8f2e197b-1e96-4741-9600-decd5cd523e1 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1314 microversion: 2.1 time: 0.157085 Nov 22 13:47:39.517618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 310/640] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:39 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:40.268715 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:40.269373 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:40.275457 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.275907 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.276668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.277091 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.477988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:40.488241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9c2efbb8-c4aa-4933-82a6-407816087f17 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.222858 Nov 22 13:47:40.489396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 331/641] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:40 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:40.534212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:40.535332 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:40.541830 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.542499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.544185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.544788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.750146 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:40.759572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8d07eaf5-3adf-4897-b2b4-abb0fc7a5cd6 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1464 microversion: 2.1 time: 0.228572 Nov 22 13:47:40.760448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 311/642] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:40 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:40.800549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:40.801129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:40.809714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.810250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.811150 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.811597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.839214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:47:40.924549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-94e52bf2-e3ef-4b9c-a155-c7aaf146570f tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "DELETE /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 204 len: 0 microversion: 2.1 time: 0.127301 Nov 22 13:47:40.925805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 332/643] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:40 2021] DELETE /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:47:40.935814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:40.936434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:40.942553 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.943103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:40.944229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:40.944952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:41.151221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:41.161005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f4769163-24d1-4c0a-ae1f-6f3fa23bfb6e tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1470 microversion: 2.1 time: 0.230564 Nov 22 13:47:41.163794 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 312/644] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:40 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:41.508125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:41.509024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:41.515806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:41.516578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:41.517583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:41.518377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:41.734511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:41.741770 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-796d54b4-724b-4003-99e0-1f1e85a936b7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.238994 Nov 22 13:47:41.742343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 333/645] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:41 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:42.179667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:42.180277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:42.186581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:42.187027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:42.187829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:42.188253 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:42.345871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:42.354311 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-102d55c6-8501-4eb4-a4c9-dcbf79db7f10 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1470 microversion: 2.1 time: 0.178269 Nov 22 13:47:42.354892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 313/646] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:42 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:42.760438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:42.760923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:42.771866 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:42.772303 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:42.773258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:42.773918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:43.070208 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:43.095568 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-08d403ca-4161-4018-9118-2cf126b1b27b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.339630 Nov 22 13:47:43.103090 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 334/647] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:42 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:43.206511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-3947482b-fefc-4a51-99fe-346ece466cb6 req-847fb79e-38fa-421e-a0c2-1110e1084f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764d1f9a-5288-4aeb-8528-27eb8ad6958e", "name": "network-vif-deleted", "tag": "e5ff694a-a0ea-43f2-a384-1fa878184012"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:43.208246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:43.208246 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:47:43.234804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-3947482b-fefc-4a51-99fe-346ece466cb6 req-847fb79e-38fa-421e-a0c2-1110e1084f3f service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:43.235466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-3947482b-fefc-4a51-99fe-346ece466cb6 req-847fb79e-38fa-421e-a0c2-1110e1084f3f service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:43.267361 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-3947482b-fefc-4a51-99fe-346ece466cb6 req-847fb79e-38fa-421e-a0c2-1110e1084f3f service nova] Creating event network-vif-deleted:e5ff694a-a0ea-43f2-a384-1fa878184012 for instance 764d1f9a-5288-4aeb-8528-27eb8ad6958e on hv-cinder-76845 Nov 22 13:47:43.281064 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-3947482b-fefc-4a51-99fe-346ece466cb6 req-847fb79e-38fa-421e-a0c2-1110e1084f3f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083595 Nov 22 13:47:43.281775 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 314/648] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:43.375403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:43.377020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:43.408976 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:43.409481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:43.410828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:43.414646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:43.426061 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1274977050", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-717166159", "security_groups": [{"name": "tempest-secgroup-smoke-460503803"}], "networks": [{"uuid": "bf9e00ac-3683-4953-9d30-6f214cc48b07"}], "block_device_mapping_v2": [{"uuid": "c07d8f10-349a-495e-92ee-e4cc2dc5babf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:43.483718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:43.484182 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:43.484645 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lazy-loading 'fault' on Instance uuid 764d1f9a-5288-4aeb-8528-27eb8ad6958e {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:43.540419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac350a0778b401aa0e8f8cf2e2fb22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fdf43be88c43dea7f50cb3df0920eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:43.549121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c4ba352c-3d3b-45fa-96f3-87708bbccf6b tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 200 len: 1304 microversion: 2.1 time: 0.179835 Nov 22 13:47:43.550201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 335/649] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:43 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:43.605226 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] validate_networks() for [('bf9e00ac-3683-4953-9d30-6f214cc48b07', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:47:44.062503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:47:44.062955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:47:44.063444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:47:44.064403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:47:44.064828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:47:44.073431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.073883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.075022 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.075471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.091605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for project ee3a9603fada4f72a111322a25c91454. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:44.095756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Getting quotas for user 3abbc6b58dd44094a88ab8d4b4587935 and project ee3a9603fada4f72a111322a25c91454. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:44.119946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:44.120566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:44.128161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.128927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.130024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.130572 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.168861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:47:44.171330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c07d8f10-349a-495e-92ee-e4cc2dc5babf',volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:47:44.307516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:44.316909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8ca145cf-d7e2-40bc-ba5d-129990eb8e86 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.200925 Nov 22 13:47:44.317540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 336/650] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:44 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:44.341307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4655576c-a3e9-4c08-820a-8818cadeee95 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.921227 Nov 22 13:47:44.342652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 315/651] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:47:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:47:44.352994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-53582d9c-a6e8-499d-a7ea-59ba41a1fed9 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:44.354751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-53582d9c-a6e8-499d-a7ea-59ba41a1fed9 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:44.414140 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-53582d9c-a6e8-499d-a7ea-59ba41a1fed9 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:44.422399 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-53582d9c-a6e8-499d-a7ea-59ba41a1fed9 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1088 microversion: 2.1 time: 0.073315 Nov 22 13:47:44.422974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 337/652] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:44 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:44.566816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:44.567632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] [instance: 764d1f9a-5288-4aeb-8528-27eb8ad6958e] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:44.575725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.576179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.581820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:44.581820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:44.592131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] HTTP exception thrown: Instance 764d1f9a-5288-4aeb-8528-27eb8ad6958e could not be found. Nov 22 13:47:44.592880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] Returning 404 to user: Instance 764d1f9a-5288-4aeb-8528-27eb8ad6958e could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:47:44.593763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-306cbca7-da0b-43d3-ab52-7596494d3067 tempest-VolumesNegativeTest-1942050864 tempest-VolumesNegativeTest-1942050864-project] 10.222.0.31 "GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e" status: 404 len: 111 microversion: 2.1 time: 0.030521 Nov 22 13:47:44.594395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 316/653] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:44 2021] GET /compute/v2.1/servers/764d1f9a-5288-4aeb-8528-27eb8ad6958e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:47:45.334435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:45.335557 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:45.344761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:45.345500 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:45.347071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:45.347722 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:45.440002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:45.440757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:45.452092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:45.452551 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:45.456499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:45.458787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:45.654350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:45.664136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-549bf640-3a77-49dd-ac10-a110879d5f85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1186 microversion: 2.1 time: 0.226111 Nov 22 13:47:45.665100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 317/654] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:45 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1186 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:45.797581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:45.815510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4454efcc-d843-4bb3-a3dd-4ad1133ccc58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.482480 Nov 22 13:47:45.827942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 338/655] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:45 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:46.681872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:46.682479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:46.695409 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:46.695859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:46.696653 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:46.697083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:46.815257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:46.833942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-714c364b-a56d-435f-bf14-9237a34ca468 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1192 microversion: 2.1 time: 0.155738 Nov 22 13:47:46.834637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:46.835251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:46.836144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 318/656] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:46 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1192 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:46.848012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:46.852488 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:46.855991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:46.855991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:47.216169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:47.227607 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cbc9c748-98f9-4941-9c2c-8e01f00b4512 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.396438 Nov 22 13:47:47.233748 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 339/657] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:46 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:47.853152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:47.853982 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:47.862100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:47.862758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:47.863809 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:47.864804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:48.202115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:48.212476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5121f71b-463b-40a7-bace-399212240d6e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.362902 Nov 22 13:47:48.213780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 319/658] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:47 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:48.262071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:48.264764 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:48.271355 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:48.271807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:48.272603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:48.273036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:48.543983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:48.557520 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-325f940f-d66a-4571-aed0-ce78c2b47ddf tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.304628 Nov 22 13:47:48.559597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 340/659] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:48 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:49.230928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:49.232602 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:49.241409 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:49.241964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:49.257918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:49.263903 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:49.581242 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:49.581242 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:49.595994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:49.597565 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:49.598691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:49.599333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:49.779111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:49.787885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0bd8b773-1876-4fba-9df5-d49aff705db0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.215050 Nov 22 13:47:49.789772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 341/660] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:49 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:50.029837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:50.047422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fe16d159-c364-41f9-80c8-63d3b1a33eb8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.820927 Nov 22 13:47:50.051280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 320/661] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:49 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:50.807269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:50.807892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:50.816535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:50.817851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:50.822196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:50.824554 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:51.165332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:51.175548 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d04fbfb1-9691-4e1d-8b6d-93d4666761d5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.372316 Nov 22 13:47:51.178829 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 342/662] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:50 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:51.193342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:51.194933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:51.215338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:51.216055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:51.218040 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:51.221920 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:51.503023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:51.519305 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-179afea7-6a43-410e-b310-13c9768d5bf2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.333837 Nov 22 13:47:51.519986 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 343/663] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:51 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:51.526091 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-35ec689e-bce5-4c2f-95f6-737f7cce58c6 req-852d1b7a-27dd-49c2-a7e0-d251be5fb5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:51.528511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:51.528511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:51.537825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-35ec689e-bce5-4c2f-95f6-737f7cce58c6 req-852d1b7a-27dd-49c2-a7e0-d251be5fb5d2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:51.538505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-35ec689e-bce5-4c2f-95f6-737f7cce58c6 req-852d1b7a-27dd-49c2-a7e0-d251be5fb5d2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:51.565670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: .version_select at 0x7f673db55940>, body: {"keypair": {"name": "tempest-keypair-1607205471"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:51.568015 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-35ec689e-bce5-4c2f-95f6-737f7cce58c6 req-852d1b7a-27dd-49c2-a7e0-d251be5fb5d2 service nova] Creating event network-changed:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:47:51.587866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:51.594018 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-35ec689e-bce5-4c2f-95f6-737f7cce58c6 req-852d1b7a-27dd-49c2-a7e0-d251be5fb5d2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072490 Nov 22 13:47:51.594343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:51.594632 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 344/664] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:51.732826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:51.738103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:51.756294 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ff116f26-cdba-4a67-8ea3-e5dfca440a41 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.727918 Nov 22 13:47:51.757153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 321/665] 10.222.0.31 () {62 vars in 1198 bytes} [Mon Nov 22 13:47:51 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 730 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 22 13:47:52.197592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:52.199427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:52.207933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:52.209704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:52.210727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:52.212595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:52.417320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:52.427228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2b90f738-c4c3-4d07-970a-c79eb97a6e8f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.232580 Nov 22 13:47:52.428352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 345/666] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:52 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:52.538417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:52.539292 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:52.548073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:52.548579 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:52.549413 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:52.549848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:52.815042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:52.828750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-41085e39-8702-4eb2-a4d1-630a805d9f7e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.296605 Nov 22 13:47:52.831488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 322/667] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:52 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:53.424206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1947506520", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13d33f4b-6ae7-4e77-b7bc-0f018ce37593"}], "security_groups": [{"name": "tempest-securitygroup--635934294"}], "key_name": "tempest-keypair-1607205471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:53.445141 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:53.445776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:53.452555 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:53.453034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:53.453906 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:53.454616 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:53.599208 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] validate_networks() for [('13d33f4b-6ae7-4e77-b7bc-0f018ce37593', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:47:53.643291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:53.653757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-762fe58e-6ffe-4ccd-b6c1-18863710458f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1678 microversion: 2.1 time: 0.212533 Nov 22 13:47:53.654563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 323/668] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:53 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:53.847715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:53.848662 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:53.865249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:53.865989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:53.866869 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:53.867318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.094244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:54.102940 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bd813efa-f0b2-41da-ad50-07b7f43d9475 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.258573 Nov 22 13:47:54.113596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 324/669] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:53 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:54.357782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:47:54.358282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:47:54.359264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:47:54.359926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:47:54.361132 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:47:54.377188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:54.381714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.382992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:54.383638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.419801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:47:54.428374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:47:54.448412 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:47:54.452033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:47:54.515722 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e1a5b47c-f2a8-4cd4-a5f6-55a43953bfd0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.095747 Nov 22 13:47:54.518661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 346/670] 10.222.0.31 () {62 vars in 1187 bytes} [Mon Nov 22 13:47:53 2021] POST /compute/v2.1/servers => generated 401 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 22 13:47:54.526627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:54.528356 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:54.673513 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:54.680899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:54.683021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:54.686248 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:54.690345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:54.690765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:54.691566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.693163 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:54.693830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.695155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b74c7df8-34cd-43b3-b764-7955f092e6cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1282 microversion: 2.20 time: 0.170558 Nov 22 13:47:54.705021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 325/671] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:47:54 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:47:54.887379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:54.895704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cfe532a5-55c9-4972-93d9-f54874813b7e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1655 microversion: 2.1 time: 0.228186 Nov 22 13:47:54.901544 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 347/672] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:54 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1655 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:54.912733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-caa0e57e-8a29-4509-ad8a-b807e9c03075 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:54.926088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-caa0e57e-8a29-4509-ad8a-b807e9c03075 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:54.927886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-caa0e57e-8a29-4509-ad8a-b807e9c03075 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:54.978008 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-caa0e57e-8a29-4509-ad8a-b807e9c03075 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Going to try to start instance {{(pid=122684) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 13:47:55.047136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-caa0e57e-8a29-4509-ad8a-b807e9c03075 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action" status: 202 len: 0 microversion: 2.1 time: 0.138051 Nov 22 13:47:55.047743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 326/673] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:47:54 2021] POST /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:47:55.057499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:55.064727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:55.075677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.076671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.079196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.080858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.121517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:55.122449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:55.135657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.136750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.137943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.138144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.411018 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:55.418861 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6a8301f5-6330-41da-9cc0-6a12c2b71313 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1664 microversion: 2.1 time: 0.366338 Nov 22 13:47:55.419663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 348/674] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:55 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1664 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:55.591672 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:55.610054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-01c14a3f-90fc-4c77-9299-fcf8d7970d69 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.493568 Nov 22 13:47:55.610980 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 327/675] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:55 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:55.713661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:55.714990 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:55.721402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.721851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.722641 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:55.723079 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:55.806374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:55.829039 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:55.830949 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:55.832139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c2824a1d-48a7-4a8f-8980-aa39c3c9d4ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1334 microversion: 2.20 time: 0.122051 Nov 22 13:47:55.832828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 349/676] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:47:55 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:47:56.437182 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:56.437851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:56.456408 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.456866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.457696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.458136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.637763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:56.639197 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:56.646859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.647691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.649113 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.649830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.755742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:56.764286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-614458b0-a402-490d-9de7-a6233f073b07 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1664 microversion: 2.1 time: 0.331192 Nov 22 13:47:56.765140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 328/677] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:56 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1664 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:56.806016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:56.824756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c3669113-39fb-403d-8874-108801bd2261 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.191624 Nov 22 13:47:56.835311 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 350/678] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:56 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:56.852400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:56.853762 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:56.863721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.865550 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.866431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:56.867646 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:56.946543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:56.957107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:56.958715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:56.959912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-96685c4d-9351-4aa6-b6fb-f9342913bb35 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1340 microversion: 2.20 time: 0.113508 Nov 22 13:47:56.960586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 329/679] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:47:56 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:47:57.783226 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:57.784023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:57.790293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:57.790839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:57.792195 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:57.793271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:57.846083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:57.847689 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:57.860061 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:57.865373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:57.867480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:57.867940 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.096483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:58.108730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7c296dcd-d6d8-4ded-8567-b036d1fd0b41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1668 microversion: 2.1 time: 0.329853 Nov 22 13:47:58.109892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 351/680] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:57 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:47:58.126644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-be40efde-ae53-457e-a14c-20b31ae94cf9 req-a97ade55-8527-41b1-add4-49266808c8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:47:58.130668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:47:58.130668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:47:58.140302 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-be40efde-ae53-457e-a14c-20b31ae94cf9 req-a97ade55-8527-41b1-add4-49266808c8a4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:58.141133 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-be40efde-ae53-457e-a14c-20b31ae94cf9 req-a97ade55-8527-41b1-add4-49266808c8a4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.155082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-be40efde-ae53-457e-a14c-20b31ae94cf9 req-a97ade55-8527-41b1-add4-49266808c8a4 service nova] Creating event network-changed:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:47:58.161542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-be40efde-ae53-457e-a14c-20b31ae94cf9 req-a97ade55-8527-41b1-add4-49266808c8a4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038391 Nov 22 13:47:58.163952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 352/681] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:47:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:47:58.174535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:58.175630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:58.184894 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:58.185724 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.186793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:58.187478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.424400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:58.431366 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:58.433764 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8c8dd834-7b05-44aa-aeed-951de3b54890 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.594546 Nov 22 13:47:58.434517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 330/682] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:57 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:58.442594 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:58.444498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:58.445807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-46491a04-6e02-41e8-833d-ac93bada0ef4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.277579 Nov 22 13:47:58.446362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 353/683] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:47:58 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:47:58.569842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:58.571130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:58.579513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:58.580328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.581412 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:58.586143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:58.684886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lazy-loading 'services' on Instance uuid 25377de6-d618-4294-876a-cafad05b1094 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:47:58.802474 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c3ed9327-4f20-4198-bab7-d9711278169d tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "DELETE /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094/os-volume_attachments/5df498f5-0b5a-474b-a559-66deac7f42c0" status: 202 len: 0 microversion: 2.1 time: 0.235799 Nov 22 13:47:58.803733 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 331/684] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:47:58 2021] DELETE /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094/os-volume_attachments/5df498f5-0b5a-474b-a559-66deac7f42c0 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:47:59.451441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:59.452055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:59.458414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.460838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.461881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.463119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.468107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:59.468897 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:59.476410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.477177 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.478006 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.478440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.696822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:59.709600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:59.711566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:59.712970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-10e2cab2-6167-4cf6-8791-b5216083ed10 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.250976 Nov 22 13:47:59.713953 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 332/685] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:47:59 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:47:59.758682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:47:59.766260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-00e80736-8105-4f44-8cd4-db1fb9e6caeb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.319099 Nov 22 13:47:59.766778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 354/686] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:47:59 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:47:59.934358 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:47:59.934844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:47:59.940729 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.941173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.941976 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:47:59.942406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:47:59.966898 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:48:00.049439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-81f3d3f3-ede1-4159-95df-168ed98e4b3e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "DELETE /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 204 len: 0 microversion: 2.1 time: 0.118451 Nov 22 13:48:00.050535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 333/687] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:47:59 2021] DELETE /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:48:00.063240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:00.065306 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:00.075909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.076380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.078060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.078765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.406451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:00.414233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e616d223-394f-46f3-9da0-b33246ee6f1e tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1514 microversion: 2.1 time: 0.358544 Nov 22 13:48:00.414889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 355/688] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:00 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:00.732796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:00.734353 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:00.740784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.741310 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.742909 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.743405 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.788045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:00.789326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:00.800227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.800676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.803981 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:00.804622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:00.932100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:00.942706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:00.944368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:00.945741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ff4b6891-7e4e-4d42-a9a7-8ab29e4286d6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.217426 Nov 22 13:48:00.946573 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 334/689] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:00 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:01.065720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:01.072925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ce4aaddf-7965-4ac5-8ab3-11394c795099 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.291675 Nov 22 13:48:01.082849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 356/690] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:00 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:01.434449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:01.435161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:01.441932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:01.442654 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:01.443690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:01.444133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:01.633139 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:01.643168 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3cbc10d3-d55d-4d8d-b826-eb1ecfc22235 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1514 microversion: 2.1 time: 0.212770 Nov 22 13:48:01.644327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 335/691] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:01 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:01.966686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:01.967903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:01.977078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:01.977821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:01.978832 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:01.979620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.090435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:02.091701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:02.098054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.098420 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.099396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.099829 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.343527 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:02.351578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-57bea345-042a-4ea7-906d-e4e6512d5cd8 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.265390 Nov 22 13:48:02.356842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 336/692] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:02 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:02.410828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:02.427166 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:02.429712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:02.432389 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4cd4401c-c62c-41e5-b02a-b1d339b608ae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.472114 Nov 22 13:48:02.434836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 357/693] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:01 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:02.450572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-1986e751-732c-464f-9d10-790e48ee0fd0 req-940203b2-f605-4ccc-b39e-015943a7e640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25377de6-d618-4294-876a-cafad05b1094", "name": "network-vif-deleted", "tag": "b22da321-fcc3-409d-945d-68ec304289dc"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:02.452248 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:02.452248 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:02.459531 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-1986e751-732c-464f-9d10-790e48ee0fd0 req-940203b2-f605-4ccc-b39e-015943a7e640 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.460212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-1986e751-732c-464f-9d10-790e48ee0fd0 req-940203b2-f605-4ccc-b39e-015943a7e640 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.488882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-1986e751-732c-464f-9d10-790e48ee0fd0 req-940203b2-f605-4ccc-b39e-015943a7e640 service nova] Creating event network-vif-deleted:b22da321-fcc3-409d-945d-68ec304289dc for instance 25377de6-d618-4294-876a-cafad05b1094 on hv-cinder-76845 Nov 22 13:48:02.494225 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-1986e751-732c-464f-9d10-790e48ee0fd0 req-940203b2-f605-4ccc-b39e-015943a7e640 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047902 Nov 22 13:48:02.495868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 337/694] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:02.661012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:02.662024 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:02.668424 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.668870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.669912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.670546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.702095 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:02.702543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:02.702988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lazy-loading 'fault' on Instance uuid 25377de6-d618-4294-876a-cafad05b1094 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:48:02.753626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc78f8e4f79641d390553bc5e1a954e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a21fcc281743ddac3e5b53b5496a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:02.761938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-125ad2e8-c721-431b-b03f-9beb126d80bf tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 200 len: 1308 microversion: 2.1 time: 0.104454 Nov 22 13:48:02.762515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 358/695] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:02 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:03.375042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:03.375837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:03.384387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.385263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.386618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.387260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.456885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:03.457514 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:03.479151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.480013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.481484 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.482243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.614517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:03.627329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-db400c98-18c5-46c8-b54d-5b096cbfc2c4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.258496 Nov 22 13:48:03.628915 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 338/696] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:03 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:03.672587 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:03.681043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:03.684829 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:03.687410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0a306c3c-0c71-47f0-ac8c-c71a22012638 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.239149 Nov 22 13:48:03.688259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 359/697] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:03 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:48:03.779011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:03.779892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] [instance: 25377de6-d618-4294-876a-cafad05b1094] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:03.786573 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.787017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.787817 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:03.788273 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:03.808186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] HTTP exception thrown: Instance 25377de6-d618-4294-876a-cafad05b1094 could not be found. Nov 22 13:48:03.810205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] Returning 404 to user: Instance 25377de6-d618-4294-876a-cafad05b1094 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:48:03.820049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1a2c5abc-13bf-4d62-be39-27f2a7c6cf50 tempest-VolumesSnapshotTestJSON-1955441166 tempest-VolumesSnapshotTestJSON-1955441166-project] 10.222.0.31 "GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094" status: 404 len: 111 microversion: 2.1 time: 0.037012 Nov 22 13:48:03.821323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 339/698] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:03 2021] GET /compute/v2.1/servers/25377de6-d618-4294-876a-cafad05b1094 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:48:04.644592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:04.645833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:04.654284 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:04.655407 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:04.656376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:04.657167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:04.705285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:04.706529 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:04.712970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:04.713451 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:04.715062 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:04.715684 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:04.878258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:04.888152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:04.893403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:04.894721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-17a71ec9-29d8-45f6-a325-b42aabcf977a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.193066 Nov 22 13:48:04.895403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 340/699] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:04 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:48:04.900486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-480730de-8dbf-4076-88ee-a9bbac8368f2 req-f95df57d-4cff-4cd1-91d8-e350c01e1665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "name": "network-vif-plugged", "status": "completed", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:04.903571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:04.903571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:04.910951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-480730de-8dbf-4076-88ee-a9bbac8368f2 req-f95df57d-4cff-4cd1-91d8-e350c01e1665 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:04.911764 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-480730de-8dbf-4076-88ee-a9bbac8368f2 req-f95df57d-4cff-4cd1-91d8-e350c01e1665 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:04.924699 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-480730de-8dbf-4076-88ee-a9bbac8368f2 req-f95df57d-4cff-4cd1-91d8-e350c01e1665 service nova] Creating event network-vif-plugged:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:48:04.934372 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-480730de-8dbf-4076-88ee-a9bbac8368f2 req-f95df57d-4cff-4cd1-91d8-e350c01e1665 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Nov 22 13:48:04.935362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 341/700] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:04.963636 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:04.972963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4140b7be-7727-4f37-9312-3f24a1f685d5 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.331822 Nov 22 13:48:04.973907 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 360/701] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:04 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:05.915690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:05.916395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:05.923687 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:05.924137 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:05.924927 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:05.925609 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:05.993158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:05.994425 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:06.002324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:06.003819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:06.004784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:06.005585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:06.106015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:06.115036 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:06.119272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:06.124070 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-59879582-45c5-40cb-b03c-85bb701eb1b9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.213198 Nov 22 13:48:06.126559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 342/702] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:05 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:06.294577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:06.312616 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b877c6b1-aa57-4840-9e95-e6e5148ee8f1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.325768 Nov 22 13:48:06.344433 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 361/703] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:05 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:06.982617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-f3812141-5cde-4a15-88df-cb0d96f6f5ce req-92e04f08-499e-45d1-ab6f-25e2f17ebe49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "name": "network-vif-plugged", "status": "completed", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:06.986639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:06.986639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:07.007618 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-f3812141-5cde-4a15-88df-cb0d96f6f5ce req-92e04f08-499e-45d1-ab6f-25e2f17ebe49 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:07.009670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-f3812141-5cde-4a15-88df-cb0d96f6f5ce req-92e04f08-499e-45d1-ab6f-25e2f17ebe49 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:07.024136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-f3812141-5cde-4a15-88df-cb0d96f6f5ce req-92e04f08-499e-45d1-ab6f-25e2f17ebe49 service nova] Creating event network-vif-plugged:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:48:07.032663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-f3812141-5cde-4a15-88df-cb0d96f6f5ce req-92e04f08-499e-45d1-ab6f-25e2f17ebe49 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057444 Nov 22 13:48:07.033728 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 343/704] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:07.144151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:07.144779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:07.165467 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:07.165902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:07.167646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:07.168262 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:07.353557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:07.355362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:07.368932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:07.372843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:07.374270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:07.378253 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:07.381918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:07.391949 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:07.398362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:07.399844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8d22dcdd-d915-4718-abec-7770189acf58 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.259856 Nov 22 13:48:07.414324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 362/705] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:07 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:07.734092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:07.744360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b07e11c5-2def-4820-9993-92be32afaec2 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.397312 Nov 22 13:48:07.746009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 344/706] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:07 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:08.420470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:08.423585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:08.430269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:08.430726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:08.431708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:08.432344 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:08.632915 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:08.641087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:08.642613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:08.643718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-887e6b41-721a-471c-ab46-2cee689258b4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.227300 Nov 22 13:48:08.644280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 363/707] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:08 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:08.764021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:08.768242 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:08.777167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:08.778502 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:08.779557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:08.780900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:08.999571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:09.009429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bc177be6-d249-4dd9-9e30-88714c2b971d tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1259 microversion: 2.1 time: 0.250366 Nov 22 13:48:09.010545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 345/708] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:08 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:09.674160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:09.681322 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:09.696236 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:09.697808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:09.699397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:09.699835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:09.862690 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:09.874209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:09.876162 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:09.877508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f3ab8803-9bd2-455b-9204-b1f1ddf9ef18 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1407 microversion: 2.20 time: 0.219131 Nov 22 13:48:09.890048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 364/709] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:09 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:48:10.032930 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:10.034149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:10.046967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.047414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.053839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.054455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.674249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:10.686242 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-744982d6-62a4-4b41-ad07-4c1956efd19f tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1443 microversion: 2.1 time: 0.663123 Nov 22 13:48:10.688054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 346/710] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:10 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1443 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:10.708387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:10.712268 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:10.723476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.726918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.728059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.728753 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.895889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:10.896677 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:10.905139 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.912329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.914388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:10.915629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:10.950763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:10.962852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9f0a3761-4324-45db-bb03-cf0a0943e323 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1443 microversion: 2.1 time: 0.261712 Nov 22 13:48:10.964892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 365/711] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:10 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1443 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:11.101834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:11.114756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:11.116287 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:11.117478 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5728f804-43a4-4598-a0a2-4929de9809e0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1599 microversion: 2.20 time: 0.225545 Nov 22 13:48:11.130855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 347/712] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:48:10 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:48:11.138555 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:11.139056 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:11.156487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:11.157081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:11.157956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:11.158398 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:11.284930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0b2891ca-5360-4090-b46b-3499dcf0d842 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.150100 Nov 22 13:48:11.285577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 366/713] 10.222.0.31 () {60 vars in 1315 bytes} [Mon Nov 22 13:48:11 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:48:13.059923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:13.061593 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:13.067346 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-d44b279c-2451-401b-9b3d-732e7afd8c22 req-b7fed807-c6db-4cc9-979d-30ec1c1aaccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:13.073620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:13.073620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:13.084224 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-d44b279c-2451-401b-9b3d-732e7afd8c22 req-b7fed807-c6db-4cc9-979d-30ec1c1aaccf service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:13.085257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-d44b279c-2451-401b-9b3d-732e7afd8c22 req-b7fed807-c6db-4cc9-979d-30ec1c1aaccf service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:13.099192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:13.099657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:13.100481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:13.100924 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:13.123642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-d44b279c-2451-401b-9b3d-732e7afd8c22 req-b7fed807-c6db-4cc9-979d-30ec1c1aaccf service nova] Creating event network-changed:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:48:13.144707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-d44b279c-2451-401b-9b3d-732e7afd8c22 req-b7fed807-c6db-4cc9-979d-30ec1c1aaccf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081096 Nov 22 13:48:13.145501 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 367/714] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:13.217609 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f2a3225c-be31-4080-8625-aa279358b496 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.161491 Nov 22 13:48:13.218270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 348/715] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:13 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:14.229837 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:14.231053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:14.245753 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:14.250363 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:14.251477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:14.251788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:14.354050 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-beab9d2e-8dbc-4e82-bfef-adc4cb489068 req-098052e9-04c1-455d-80b4-d9e4933c8d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:14.356382 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:14.356382 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:14.374810 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-beab9d2e-8dbc-4e82-bfef-adc4cb489068 req-098052e9-04c1-455d-80b4-d9e4933c8d33 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:14.386666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-beab9d2e-8dbc-4e82-bfef-adc4cb489068 req-098052e9-04c1-455d-80b4-d9e4933c8d33 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:14.411260 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-beab9d2e-8dbc-4e82-bfef-adc4cb489068 req-098052e9-04c1-455d-80b4-d9e4933c8d33 service nova] Creating event network-changed:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:48:14.418650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-beab9d2e-8dbc-4e82-bfef-adc4cb489068 req-098052e9-04c1-455d-80b4-d9e4933c8d33 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068813 Nov 22 13:48:14.423018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 349/716] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:48:16.756021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-55574c75-3ab7-4752-b279-a756c729b8eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 2.531143 Nov 22 13:48:16.757792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 368/717] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:14 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:17.769173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:17.771051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:17.778767 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:17.779298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:17.780161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:17.780667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:17.844929 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ce6ad901-8d05-43e6-8913-cab6ed897068 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.080658 Nov 22 13:48:17.848774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 350/718] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:17 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:18.857932 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:18.858835 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:18.866028 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:18.866702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:18.867492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:18.868089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:18.933042 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-192fb096-d6d2-478f-9709-a6d63efd052b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.080684 Nov 22 13:48:18.934247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 369/719] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:18 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:19.944986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:19.946053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:19.954643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:19.955094 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:19.955911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:19.956368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:20.036648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3ccabb28-1d3f-4e72-9e86-515a7066343d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.095665 Nov 22 13:48:20.037321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 351/720] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:19 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:20.248664 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:48:20.249161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: Mon Nov 22 13:48:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:48:20.700772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'create', calling method: .version_select at 0x7f673dbe7e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1522226046"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:20.716749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for project cfdbcd612796433d849fc488aa45a196. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:20.720799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for user 347302854280447e84ccf98931967625 and project cfdbcd612796433d849fc488aa45a196. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:20.954271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for project cfdbcd612796433d849fc488aa45a196. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:20.957775 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for user 347302854280447e84ccf98931967625 and project cfdbcd612796433d849fc488aa45a196. Resources: {'key_pairs'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:20.970828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ef03dc95-fcea-428a-ba81-0c5e2c916172 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.274571 Nov 22 13:48:20.971416 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 370/721] 10.222.0.31 () {60 vars in 1157 bytes} [Mon Nov 22 13:48:20 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:21.019623 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-463205133", "imageRef": "0723ca7c-59b0-4f5f-aa7d-c824c2d0597b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1522226046", "networks": [{"uuid": "f304a141-d2bc-4f74-9e70-9594aac65216"}]}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:21.048568 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:21.049619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:21.055482 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:21.055919 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:21.056704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:21.057922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:21.072105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.network.neutron [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] validate_networks() for [('f304a141-d2bc-4f74-9e70-9594aac65216', None, None, None, None, None)] {{(pid=122684) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:48:21.120221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3bceed35-bd0a-4a7f-8b4c-2064d85033b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.075047 Nov 22 13:48:21.123396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 371/722] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:21 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:21.455869 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Flavor limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:48:21.456290 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Image limits 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:48:21.456763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Flavor pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:48:21.457171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Image pref 0:0:0 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:48:21.457609 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.virt.hardware [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:48:21.466497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:21.466943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:21.467757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:21.468192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:21.484700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for project cfdbcd612796433d849fc488aa45a196. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:21.488522 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Getting quotas for user 347302854280447e84ccf98931967625 and project cfdbcd612796433d849fc488aa45a196. Resources: {'ram', 'instances', 'cores'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:21.500240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Going to run 1 instances... {{(pid=122684) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:48:21.502592 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0723ca7c-59b0-4f5f-aa7d-c824c2d0597b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:48:21.548241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-28cfebac-8899-4109-b94e-bc7e7f29ad97 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532585 Nov 22 13:48:21.549051 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 352/723] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:48:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:48:21.559917 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bae8a658-c26d-40a0-9d50-8073a6cd409b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:21.560652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bae8a658-c26d-40a0-9d50-8073a6cd409b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:21.620519 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bae8a658-c26d-40a0-9d50-8073a6cd409b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:21.626958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bae8a658-c26d-40a0-9d50-8073a6cd409b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1258 microversion: 2.1 time: 0.071580 Nov 22 13:48:21.627918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 372/724] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:21 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:22.131836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:22.132951 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:22.139442 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:22.139986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:22.140861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:22.141345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:22.209288 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c4be344c-944b-414b-8bb3-b4375859adf5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 14 microversion: 2.20 time: 0.081795 Nov 22 13:48:22.210147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 353/725] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:22 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:22.645454 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:22.646160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:22.654224 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:22.654687 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:22.655523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:22.656143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:22.745160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:22.754389 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4a08a9f3-ab10-4d2c-bdf2-a35d4126f642 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1316 microversion: 2.1 time: 0.112772 Nov 22 13:48:22.755071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 373/726] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:22 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:23.226198 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:23.227208 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:23.238845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:23.239301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:23.240271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:23.240892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:23.771699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:23.772329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:23.779972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:23.780430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:23.781248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:23.781756 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:23.921595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:23.929575 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a5e8574b-5bb2-45f0-bc36-8bb824e301f9 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.161546 Nov 22 13:48:23.930149 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 374/727] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:23 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:24.947568 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:24.949364 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:24.961249 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:24.961792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:24.962671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:24.963740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:25.102019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:25.111615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-38669263-05a0-44f4-95c4-46f1c9d335d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.167977 Nov 22 13:48:25.112387 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 375/728] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:24 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:26.130125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:26.130763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:26.137021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:26.137529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:26.138304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:26.138852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:26.276890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:26.285489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9202704b-2636-49c9-bb7a-50def98f9df0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.159052 Nov 22 13:48:26.286247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 376/729] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:26 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:27.303248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:27.304908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:27.314355 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:27.315276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:27.316463 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:27.316936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:27.561871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:27.569405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6a8bebb3-2670-4952-b191-62395257a073 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.270032 Nov 22 13:48:27.570527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 377/730] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:27 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:28.590277 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:28.591766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:28.598681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:28.599221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:28.600196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:28.600777 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:28.751998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:28.762885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-10774682-a9ca-4b52-9799-cb2537bf42bc tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.180116 Nov 22 13:48:28.763823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 378/731] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:28 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:29.780395 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:29.781172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:29.787379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:29.787826 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:29.788607 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:29.789040 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:29.925691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:29.933703 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0775969f-2dfb-40a3-9d77-ad8948e3ac9d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.157672 Nov 22 13:48:29.934265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 379/732] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:29 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:30.951741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:30.952521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:30.958707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:30.959159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:30.959973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:30.960423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:31.093006 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:31.100472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d4556233-a26b-41bf-84f5-dcce3af909df tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.153514 Nov 22 13:48:31.101043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 380/733] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:30 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:32.119153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:32.121086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:32.128054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:32.128506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:32.129327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:32.129766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:32.279212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:32.287187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-275e833d-6e68-467b-ac3d-657bf43fd5de tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.171888 Nov 22 13:48:32.288202 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 381/734] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:32 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:33.305537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:33.306323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:33.313473 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:33.313939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:33.314746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:33.315187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:33.447761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:33.455845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-30308260-b5bb-44e4-91c9-dfa6eaa21e77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.153987 Nov 22 13:48:33.456418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 382/735] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:33 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:34.473419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:34.474155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:34.481012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:34.481492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:34.482468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:34.482944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:34.621596 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:34.629795 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-07a2dc6a-b324-417c-862e-8dcac14c8865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.159900 Nov 22 13:48:34.630728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 383/736] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:34 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:35.647042 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:35.647765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:35.654022 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:35.654481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:35.655270 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:35.655714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:35.785691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:35.793695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5e55b456-0a47-4c26-98b2-507e5f254b77 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.150265 Nov 22 13:48:35.794262 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 384/737] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:35 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:35.875672 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-65c0490a-ad80-40d6-b7f8-8566a7903cec tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 27771 microversion: 2.20 time: 12.658216 Nov 22 13:48:35.876329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 354/738] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:23 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 27771 bytes in 12660 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:36.446498 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-237ac362-06a4-4cb2-bbf8-ab456d6e6187 req-1241d4bf-a247-4739-9555-4cfb1267f6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:36.448952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:36.448952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:36.457506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-237ac362-06a4-4cb2-bbf8-ab456d6e6187 req-1241d4bf-a247-4739-9555-4cfb1267f6c4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:36.458285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-237ac362-06a4-4cb2-bbf8-ab456d6e6187 req-1241d4bf-a247-4739-9555-4cfb1267f6c4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:36.478604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-237ac362-06a4-4cb2-bbf8-ab456d6e6187 req-1241d4bf-a247-4739-9555-4cfb1267f6c4 service nova] Creating event network-changed:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:48:36.484320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-237ac362-06a4-4cb2-bbf8-ab456d6e6187 req-1241d4bf-a247-4739-9555-4cfb1267f6c4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043605 Nov 22 13:48:36.484889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 385/739] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:36.811679 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:36.812406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:36.819394 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:36.819843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:36.820629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:36.821064 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:36.889541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:36.890540 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:36.896886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:36.897364 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:36.898926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:36.899380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.000548 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-355f7a17-7fb2-4c03-b3c3-5f297ab43206 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28029 microversion: 2.20 time: 0.116003 Nov 22 13:48:37.001853 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 386/740] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:36 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28029 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:37.129503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:37.138356 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-21132b46-4bbf-4a46-b71e-8a57daadaaef tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.331011 Nov 22 13:48:37.148120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 355/741] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:36 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:37.231567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:37.232560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:37.239076 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.239530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.240308 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.240909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.274365 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e0eaf608-d42a-440f-99bf-9b0ee6bd88ba tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047544 Nov 22 13:48:37.275676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 387/742] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:48:37 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:48:37.336610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:37.337114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:37.344133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.344133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.344850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.345375 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.371425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:48:37.456135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c9267563-077d-47ec-a06a-477d65b42bec tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 204 len: 0 microversion: 2.1 time: 0.122952 Nov 22 13:48:37.456910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 356/743] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:48:37 2021] DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:48:37.465318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:37.466127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:37.472794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.474615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.475675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:37.476682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:37.740467 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:37.748146 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f23e8d6f-e712-494e-8bdc-466f8da538d4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1674 microversion: 2.1 time: 0.286830 Nov 22 13:48:37.748749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 388/744] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:37 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:38.013111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:38.014135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:38.020286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.020730 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.021534 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.021964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.107934 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c285a36e-9b9a-482c-8b82-fce52a7b3e62 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28200 microversion: 2.20 time: 0.099433 Nov 22 13:48:38.108596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 357/745] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:38 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:38.155445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:38.156061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:38.162356 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.162814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.163598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.164042 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.294863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:38.302066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fea3da3b-0282-48a1-81e2-7294422535f4 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.150288 Nov 22 13:48:38.302656 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 389/746] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:38 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:38.767258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:38.767952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:38.774754 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.775199 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.775970 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:38.776516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:38.910726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:38.918537 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d94a9cb1-4114-4902-af62-98df99f5bbc9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1674 microversion: 2.1 time: 0.155220 Nov 22 13:48:38.919111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 358/747] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:38 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:39.119335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:39.120350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:39.126980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.127369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:39.128438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.128878 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:39.207595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-be2331bc-4931-4225-bcf5-01d44c9b9820 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28200 microversion: 2.20 time: 0.091778 Nov 22 13:48:39.208506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 390/748] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:39 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:39.318541 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:39.319214 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:39.326207 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.326661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:39.327450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.327894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:39.460436 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:39.468418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-950d1945-b2e5-40f1-9eee-13fe952de250 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.153474 Nov 22 13:48:39.469014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 359/749] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:39 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:39.936327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:39.937035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:39.943826 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.944283 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:39.945069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:39.945534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:40.152684 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:40.159953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b19e17b5-d896-440a-9ced-2a1100cb08bd tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1674 microversion: 2.1 time: 0.228039 Nov 22 13:48:40.160523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 391/750] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:39 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:40.219683 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:40.220516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:40.228445 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:40.228896 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:40.229908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:40.230657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:40.294598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e2d5ece8-2660-4524-8755-fba78678bb93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28200 microversion: 2.20 time: 0.078343 Nov 22 13:48:40.298345 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 360/751] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:40 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28200 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:40.484559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:40.485181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:40.491404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:40.491870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:40.492644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:40.493083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.007074 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:41.014957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8ce6e2d7-6c6c-4864-8ede-07a5bfee18d0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.534128 Nov 22 13:48:41.015532 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 392/752] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:40 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:41.126577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-4afdcaa5-7b7a-4a13-9201-d0402b39a570 req-9848f1ee-a083-423d-8998-8100639b47d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "name": "network-vif-plugged", "status": "completed", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:41.128641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:41.128641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:41.138032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-4afdcaa5-7b7a-4a13-9201-d0402b39a570 req-9848f1ee-a083-423d-8998-8100639b47d4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.138461 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-4afdcaa5-7b7a-4a13-9201-d0402b39a570 req-9848f1ee-a083-423d-8998-8100639b47d4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.150855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-4afdcaa5-7b7a-4a13-9201-d0402b39a570 req-9848f1ee-a083-423d-8998-8100639b47d4 service nova] Creating event network-vif-plugged:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:48:41.157548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-4afdcaa5-7b7a-4a13-9201-d0402b39a570 req-9848f1ee-a083-423d-8998-8100639b47d4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Nov 22 13:48:41.158708 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 361/753] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:41.178422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:41.181439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:41.196450 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.197184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.199003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.199895 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.253073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-6a419bbb-4428-4ac0-8582-5d1159907ef4 req-2a9d6a75-dad5-4702-871e-488b5badeb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bbd747-629b-485c-a1b2-e964b23cd5e6", "name": "network-vif-deleted", "tag": "240f0463-d6f8-4b28-8e80-f50d6a9dfe1f"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:41.254910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:41.254910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:41.271350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-6a419bbb-4428-4ac0-8582-5d1159907ef4 req-2a9d6a75-dad5-4702-871e-488b5badeb53 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.271350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-6a419bbb-4428-4ac0-8582-5d1159907ef4 req-2a9d6a75-dad5-4702-871e-488b5badeb53 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.294967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-6a419bbb-4428-4ac0-8582-5d1159907ef4 req-2a9d6a75-dad5-4702-871e-488b5badeb53 service nova] Creating event network-vif-deleted:240f0463-d6f8-4b28-8e80-f50d6a9dfe1f for instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 on hv-cinder-76845 Nov 22 13:48:41.299700 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:41.311244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-58242056-23d2-40dd-8401-baf07a05ed36 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 200 len: 1606 microversion: 2.1 time: 0.137859 Nov 22 13:48:41.313848 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 393/754] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:41 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 1606 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:41.318118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-6a419bbb-4428-4ac0-8582-5d1159907ef4 req-2a9d6a75-dad5-4702-871e-488b5badeb53 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069851 Nov 22 13:48:41.321880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 362/755] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:41.330668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:41.331950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:41.338475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.339883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.340780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:41.341538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:41.439027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-34383886-8139-4b58-8f30-49efbb962954 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28491 microversion: 2.20 time: 0.122832 Nov 22 13:48:41.440476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 394/756] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:41 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28491 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:42.032612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:42.033474 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:42.043351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.043712 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.044721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.045154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.191895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:42.199961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a6ce1b1d-f236-4c56-b56a-209694ba2744 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1358 microversion: 2.1 time: 0.171935 Nov 22 13:48:42.202974 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 363/757] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:42 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:42.331549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:42.332455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:42.339053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.339506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.340797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.341454 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.358071 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. Nov 22 13:48:42.358565 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:48:42.359389 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9189348f-cf3a-4b5c-b4a2-7ff84ed8793f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 404 len: 111 microversion: 2.1 time: 0.031984 Nov 22 13:48:42.359938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 395/758] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:42 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:48:42.368084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b5ab7bc0-0928-4816-aaef-4df628f37d3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '.version_select at 0x7f673db64700>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:42.388141 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b5ab7bc0-0928-4816-aaef-4df628f37d3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339427919" status: 202 len: 0 microversion: 2.1 time: 0.023542 Nov 22 13:48:42.388994 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 364/759] 10.222.0.31 () {58 vars in 1220 bytes} [Mon Nov 22 13:48:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339427919 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:42.453493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:42.454882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:42.462707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.463602 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.465255 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:42.465914 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:42.570654 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fc75a7fb-10ce-4d4c-9886-9069c6957267 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28659 microversion: 2.20 time: 0.123293 Nov 22 13:48:42.572190 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 396/760] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:42 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28659 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:43.077363 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: .version_select at 0x7f673daf7430>, body: {"keypair": {"name": "tempest-keypair-1540833308"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:43.092585 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:43.096639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:43.218069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:43.218767 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:43.225668 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.226139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.226933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.227373 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.299009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:43.302491 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:43.315224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-640aa4b0-5b8c-47b2-8876-8e09096d805c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.242340 Nov 22 13:48:43.316056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 365/761] 10.222.0.31 () {60 vars in 1157 bytes} [Mon Nov 22 13:48:43 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:43.364188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:43.372549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-240e603a-9933-433e-9f2c-e07ba37e0b89 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1548 microversion: 2.1 time: 0.159149 Nov 22 13:48:43.373127 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 397/762] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:43 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:43.389763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:43.390574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:43.396689 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.397261 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.398368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.398780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.573667 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:43.581642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d9621b1b-84a3-4076-8af3-bab11a11e689 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1548 microversion: 2.1 time: 0.196124 Nov 22 13:48:43.582213 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 366/763] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:43 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:43.584343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:43.586046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:43.593331 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.593940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.594972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.595705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.602419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:43.606985 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:43.606985 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:43.608895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:43.609809 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Searching by: {'deleted': False, 'project_id': 'cfdbcd612796433d849fc488aa45a196'} {{(pid=122684) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 22 13:48:43.617056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.617675 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.618485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.618914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.666818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a19afd4a-a8d9-4dff-9649-00662657f71f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28659 microversion: 2.20 time: 0.087236 Nov 22 13:48:43.668952 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 398/764] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:43 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28659 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:43.717362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.multi_cell_list [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122684) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 22 13:48:43.815627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-25097a48-eb16-4e35-801e-73bd82ad824a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217332 Nov 22 13:48:43.816463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 367/765] 10.222.0.31 () {58 vars in 1124 bytes} [Mon Nov 22 13:48:43 2021] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:48:43.831780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:43.832415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:43.841837 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.843235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:43.845130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:43.845844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:44.079721 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:44.088229 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5d76a915-8905-4ebb-944c-1cae4ae5ee28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1548 microversion: 2.1 time: 0.262146 Nov 22 13:48:44.100093 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 399/766] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:43 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1548 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:44.679502 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:44.680736 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:44.687825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:44.688257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:44.689041 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:44.689508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:44.758020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4f0dbc54-33ae-4009-bb25-8a5dac9e93ff tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28659 microversion: 2.20 time: 0.082168 Nov 22 13:48:44.758686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 368/767] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:44 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28659 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:44.922755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1027764166", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7706b4f-e379-4641-9c77-35453cbb2b93"}], "security_groups": [{"name": "tempest-securitygroup--66339660"}], "key_name": "tempest-keypair-1540833308", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:45.033328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] validate_networks() for [('e7706b4f-e379-4641-9c77-35453cbb2b93', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:48:45.480408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:48:45.480833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:48:45.481350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:48:45.481766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:48:45.482183 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:48:45.491005 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.491455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.492281 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.492720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.509329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for project 88b94d04bded4b188291cfa01accf7af. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:45.513871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Getting quotas for user fdb145d6436b45f5a028a84f35522a63 and project 88b94d04bded4b188291cfa01accf7af. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:45.524319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:48:45.527567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:48:45.572588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-50bdde7b-3dbe-4419-b1d5-d2f5dd9b5d67 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.653846 Nov 22 13:48:45.574158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 400/768] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:48:44 2021] POST /compute/v2.1/servers => generated 400 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:48:45.584394 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2ac7c40f-069c-402c-8f8d-e29aac6ccced tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:45.585086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2ac7c40f-069c-402c-8f8d-e29aac6ccced tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:45.638283 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f9affad-c6ac-49fe-990f-3982c9b3be47"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:45.639582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:45.645901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2ac7c40f-069c-402c-8f8d-e29aac6ccced tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:45.646154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.646605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.647490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.648357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.653257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2ac7c40f-069c-402c-8f8d-e29aac6ccced tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1238 microversion: 2.1 time: 0.072661 Nov 22 13:48:45.653833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 369/769] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:45 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:45.770250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:45.771267 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:45.778742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.779190 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.779977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:45.780638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:45.851842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b80ad6fd-29dd-4718-bb0a-6520483b6e13 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 28659 microversion: 2.20 time: 0.085200 Nov 22 13:48:45.853252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 370/770] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:45 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 28659 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:45.895679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6eff1203-f909-49b5-8976-89d2c798b81a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261961 Nov 22 13:48:45.896323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 401/771] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:48:45 2021] POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:48:46.795768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:46.797630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:46.805357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:46.805878 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:46.806737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:46.807245 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:46.865727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:46.866811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:46.874525 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:46.875819 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:46.876791 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:46.877799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:46.887159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:46.895313 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0957aa71-8b4f-4648-b209-8945dc09f3b0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1308 microversion: 2.1 time: 0.229425 Nov 22 13:48:46.896252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 371/772] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:46 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:46.972062 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8e8bb399-3258-461b-8d29-647fc2265570 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 29883 microversion: 2.20 time: 0.110833 Nov 22 13:48:46.973087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 402/773] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:46 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 29883 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:47.913652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:47.914298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:47.920701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:47.921146 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:47.921977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:47.922404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:47.985890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:47.987250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:48.000490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:48.001094 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:48.001814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:48.002356 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:48.108791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:48.117360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5b8406f9-949c-457b-a46f-47d067c6e562 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 31509 microversion: 2.20 time: 0.136713 Nov 22 13:48:48.117681 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c97a303e-8714-4572-9e38-65e64276a5df tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.207530 Nov 22 13:48:48.119039 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 372/774] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:47 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:48.123007 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 403/775] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:47 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 31509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:48.230249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-cbdd5cea-d051-4a61-832a-991fc38fa267 req-a907dbcd-506b-42a9-8e74-5c2e0d34e050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee44f9f7-0e5d-4b71-812f-45aa270dd3c9", "tag": "888d1f24-4a64-414c-ad37-27c5acf7246d"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:48.232240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:48.232240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:48:48.242704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-cbdd5cea-d051-4a61-832a-991fc38fa267 req-a907dbcd-506b-42a9-8e74-5c2e0d34e050 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:48.243156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-cbdd5cea-d051-4a61-832a-991fc38fa267 req-a907dbcd-506b-42a9-8e74-5c2e0d34e050 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:48.258875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-cbdd5cea-d051-4a61-832a-991fc38fa267 req-a907dbcd-506b-42a9-8e74-5c2e0d34e050 service nova] Creating event network-changed:888d1f24-4a64-414c-ad37-27c5acf7246d for instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 on hv-cinder-76845 Nov 22 13:48:48.264827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-cbdd5cea-d051-4a61-832a-991fc38fa267 req-a907dbcd-506b-42a9-8e74-5c2e0d34e050 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041132 Nov 22 13:48:48.265834 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 373/776] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:48:49.130821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:49.131817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:49.140472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.141400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.141747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.142177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.146449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:49.147156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:49.154293 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.154750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.155538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.156140 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.222081 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-516e3b72-bda5-44d0-bacd-b9b311b14811 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 32904 microversion: 2.20 time: 0.095343 Nov 22 13:48:49.223437 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 404/777] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:49 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 32904 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:49.297001 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:49.304187 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-9c9f0423-db26-427c-89fd-5accf2f05f8e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.169106 Nov 22 13:48:49.304758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 374/778] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:49 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:49.791820 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:49.792429 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:49.799220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.799663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.800434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.800872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.825757 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:48:49.900526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2705844a-1660-414b-b44b-5097697fb4e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 204 len: 0 microversion: 2.1 time: 0.112245 Nov 22 13:48:49.901858 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 405/779] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:48:49 2021] DELETE /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:48:49.909697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:49.910307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:49.917935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.918746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:49.920131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:49.920898 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:50.052475 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:50.059890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f0ec84ec-7a4b-4300-a66e-7b5a1ae12781 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1579 microversion: 2.1 time: 0.153890 Nov 22 13:48:50.060459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 375/780] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:49 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:50.234719 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:50.235714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:50.242101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:50.242552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:50.243330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:50.243766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:50.314891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f03bbb22-6852-4216-9742-6a779f0f37fc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 33695 microversion: 2.20 time: 0.084527 Nov 22 13:48:50.316185 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 406/781] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:50 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 33695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:50.321515 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:50.322153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:50.329545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:50.329996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:50.330774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:50.331209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:50.459224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:50.466638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1f18b383-146e-498d-bfde-e689c0a308a9 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.148737 Nov 22 13:48:50.467203 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 376/782] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:50 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:51.078893 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:51.079596 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:51.086441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.086896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.087688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.088147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.226239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:51.234263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-de25f3c2-26b0-412d-bc7f-4c4bbd2bd947 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1579 microversion: 2.1 time: 0.159422 Nov 22 13:48:51.235092 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 407/783] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:51 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:51.327241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:51.328211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:51.334556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.335012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.335827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.336266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.413759 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-49186505-fcd9-4b80-aec3-36af1de4d675 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 34449 microversion: 2.20 time: 0.090919 Nov 22 13:48:51.414393 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 377/784] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:51 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 34449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:51.482962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:51.483573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:51.489842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.490327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.491111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:51.491550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:51.628116 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:51.636169 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-55d0babf-4b29-4375-aa9a-643ccb85a749 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.156195 Nov 22 13:48:51.637000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 408/785] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:51 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:52.251629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:52.252239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:52.259488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.259942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.261514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.261956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.427477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:52.429746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:52.430787 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:52.440301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.441082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.442392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.443499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.466011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-96b3c5c6-dda0-47c7-abca-7d60712a57db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 200 len: 1579 microversion: 2.1 time: 0.218248 Nov 22 13:48:52.466615 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 378/786] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:52 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 1579 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:52.538318 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d51ee2c2-919a-414d-a019-b20fda0d8e5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 35050 microversion: 2.20 time: 0.116467 Nov 22 13:48:52.541772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 409/787] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:52 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 35050 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:52.652916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:52.653577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:52.659802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.660254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.661032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.661485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.727875 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-6571ff51-70b0-473d-b60b-1ef79ea792d5 req-d3804fdc-3692-4f10-a0ed-05d005f95046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad79f610-9b3d-4c71-a797-2b9ec9602b6c", "name": "network-vif-deleted", "tag": "64d8bc36-2015-4ba9-8e04-f54b659d4fa1"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:52.729531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:52.729531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:52.741497 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6571ff51-70b0-473d-b60b-1ef79ea792d5 req-d3804fdc-3692-4f10-a0ed-05d005f95046 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:52.742083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6571ff51-70b0-473d-b60b-1ef79ea792d5 req-d3804fdc-3692-4f10-a0ed-05d005f95046 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:52.755839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-6571ff51-70b0-473d-b60b-1ef79ea792d5 req-d3804fdc-3692-4f10-a0ed-05d005f95046 service nova] Creating event network-vif-deleted:64d8bc36-2015-4ba9-8e04-f54b659d4fa1 for instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c on hv-cinder-76845 Nov 22 13:48:52.762128 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-6571ff51-70b0-473d-b60b-1ef79ea792d5 req-d3804fdc-3692-4f10-a0ed-05d005f95046 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038090 Nov 22 13:48:52.762733 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 410/788] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:52.821389 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:52.830666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-85929ce8-0dbc-4c81-82bb-db530543f00a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.181327 Nov 22 13:48:52.831939 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 379/789] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:52 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:53.439610 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-30de8ad4-e95a-44e0-92b0-1d7a7b021e6c req-df7f43ea-9a9a-4334-9003-9ae0e5ae4da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee44f9f7-0e5d-4b71-812f-45aa270dd3c9", "name": "network-vif-plugged", "status": "completed", "tag": "888d1f24-4a64-414c-ad37-27c5acf7246d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:53.441096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:53.441096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:53.460332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-30de8ad4-e95a-44e0-92b0-1d7a7b021e6c req-df7f43ea-9a9a-4334-9003-9ae0e5ae4da3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.460978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-30de8ad4-e95a-44e0-92b0-1d7a7b021e6c req-df7f43ea-9a9a-4334-9003-9ae0e5ae4da3 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.475705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-30de8ad4-e95a-44e0-92b0-1d7a7b021e6c req-df7f43ea-9a9a-4334-9003-9ae0e5ae4da3 service nova] Creating event network-vif-plugged:888d1f24-4a64-414c-ad37-27c5acf7246d for instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 on hv-cinder-76845 Nov 22 13:48:53.485280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:53.485904 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:53.488793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-30de8ad4-e95a-44e0-92b0-1d7a7b021e6c req-df7f43ea-9a9a-4334-9003-9ae0e5ae4da3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053425 Nov 22 13:48:53.490103 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 411/790] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:53.512586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.513034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.517414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.517907 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.548278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] HTTP exception thrown: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. Nov 22 13:48:53.548880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Returning 404 to user: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:48:53.549749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bb13205c-5fb3-4c49-b542-1df3d36d805d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 404 len: 111 microversion: 2.1 time: 0.069321 Nov 22 13:48:53.550300 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 380/791] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:53 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:48:53.551869 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:53.553073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:53.566759 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.571291 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.574567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.575584 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.590195 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:53.590803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:53.610888 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.611556 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.613411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.614021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.692344 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-53e1b019-8a76-4727-a49d-897e31b0d99a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 36104 microversion: 2.20 time: 0.145294 Nov 22 13:48:53.693358 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 412/792] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:53 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 36104 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:53.698823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1966494786", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445698613", "security_groups": [{"name": "tempest-secgroup-smoke-451825004"}], "block_device_mapping_v2": [{"uuid": "b1a9caba-caf9-4d0e-bccc-2320253ac784", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1613968-954e-4fd7-ab36-ee6aeaa13142"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:53.792992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:53.801907 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-17e80cd1-ac1d-4174-bb16-6a0be70e45ae tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1594 microversion: 2.1 time: 0.218002 Nov 22 13:48:53.803173 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 381/793] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:53 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1594 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:53.849144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:53.850280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:53.857360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.858135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.859166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:53.859930 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:53.871710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] validate_networks() for [('d1613968-954e-4fd7-ab36-ee6aeaa13142', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:48:54.049483 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:54.060917 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3b532e07-4e92-41e9-8103-b862c3abb8c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.216658 Nov 22 13:48:54.062114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 382/794] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:53 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:54.522727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:48:54.523726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:48:54.524209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:48:54.524623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:48:54.525038 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:48:54.534758 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:54.535213 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:54.536034 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:54.536474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:54.554003 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:48:54.558206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for user 526b9ef5f3674c13b98a9ce5e30923f4 and project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:48:54.618403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:48:54.621170 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1a9caba-caf9-4d0e-bccc-2320253ac784',volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:48:54.704725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:54.705842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:54.711693 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:54.712404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:54.713067 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:54.714849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:54.750899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-afe9bf96-fdcf-467a-9b8f-33f9d7a58102 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.056187 Nov 22 13:48:54.757241 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 413/795] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:48:53 2021] POST /compute/v2.1/servers => generated 405 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:48:54.762765 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-65ed0c93-0ae8-4bf5-a5da-950534e9e826 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:54.763730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-65ed0c93-0ae8-4bf5-a5da-950534e9e826 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:54.800849 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-860c23d2-227b-4350-8b68-2919a015b35a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 37264 microversion: 2.20 time: 0.099415 Nov 22 13:48:54.802944 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 383/796] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:54 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 37264 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:54.824631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-65ed0c93-0ae8-4bf5-a5da-950534e9e826 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:54.832651 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-65ed0c93-0ae8-4bf5-a5da-950534e9e826 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1095 microversion: 2.1 time: 0.074134 Nov 22 13:48:54.833355 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 414/797] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:54 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:55.080371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:55.081519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:55.094617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.095074 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.095910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.097053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.368644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:55.386932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bc30a3de-56c8-450f-8759-a3d96f363297 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1362 microversion: 2.1 time: 0.310381 Nov 22 13:48:55.387520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 384/798] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:55 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:55.799569 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-9c1f33e1-d656-46f2-96e3-342e9d0519da req-39d1cf1d-2886-4779-aa35-ff77f85105f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:55.801160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:55.801160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:55.813660 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:55.814580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:55.821504 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9c1f33e1-d656-46f2-96e3-342e9d0519da req-39d1cf1d-2886-4779-aa35-ff77f85105f2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.823244 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.823893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.824853 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.825415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.825629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-9c1f33e1-d656-46f2-96e3-342e9d0519da req-39d1cf1d-2886-4779-aa35-ff77f85105f2 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.843374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-9c1f33e1-d656-46f2-96e3-342e9d0519da req-39d1cf1d-2886-4779-aa35-ff77f85105f2 service nova] Creating event network-changed:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:48:55.863060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-9c1f33e1-d656-46f2-96e3-342e9d0519da req-39d1cf1d-2886-4779-aa35-ff77f85105f2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067002 Nov 22 13:48:55.865799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 415/799] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:55.871939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:55.872681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:55.879402 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.879941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.880929 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:55.881559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:55.924044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e703cb34-0f6b-4fb2-9cbc-4d564f381431 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 38139 microversion: 2.20 time: 0.113931 Nov 22 13:48:55.925270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 385/800] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:55 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 38139 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:55.985096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:55.995230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fc1abf03-bd8f-4e7e-bdaf-3e63284aed11 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1201 microversion: 2.1 time: 0.127376 Nov 22 13:48:55.996224 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 416/801] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:55 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1201 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:56.408032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:56.409159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:56.420102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.421436 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.422459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.423452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.802265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:56.812589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cab36c5c-53e9-4d8a-9d95-bd01993625a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1548 microversion: 2.1 time: 0.410522 Nov 22 13:48:56.817027 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 386/802] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:56 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1548 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:56.836583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:56.838897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:56.845761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.846441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.847419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.848036 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.939152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:56.940663 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:56.949186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.950175 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.951498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:56.952251 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:56.972413 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-51dd97f7-9a4e-416d-bdbd-352b84a9bb58 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144671 Nov 22 13:48:56.973689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 417/803] 10.222.0.31 () {58 vars in 1274 bytes} [Mon Nov 22 13:48:56 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:57.018098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:57.019227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:57.028148 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:57.029105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:57.030172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:57.030855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:57.075890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fde17c9c-afc4-43e6-b6f8-4da5a4a03251 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 38212 microversion: 2.20 time: 0.141598 Nov 22 13:48:57.080885 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 387/804] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:56 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 38212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:57.487320 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:57.495216 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-eae12588-af6f-4cb1-a794-95c3f68f2ebe tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.485584 Nov 22 13:48:57.495928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 418/805] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:57 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:57.565557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-21921982"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:57.566175 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:57.573937 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:57.574390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:57.575212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:57.575648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:57.710598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.network.security_group_api [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Adding security group c370e65b-0197-4f66-805f-ce0da72afd56 to port 899b8778-cdd6-4c85-97ba-5ca10edfb816 Nov 22 13:48:58.088860 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:58.090470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:58.100702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.109191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.113329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.113960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.196561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-20f9d085-33dc-46a2-a3cc-0a5193ee8f8b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 38212 microversion: 2.20 time: 0.110659 Nov 22 13:48:58.197674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 419/806] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:58 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 38212 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:48:58.384180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f8033dce-c6b5-4a25-b1e8-5fa48af9d322 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action" status: 202 len: 0 microversion: 2.1 time: 0.822742 Nov 22 13:48:58.385963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 388/807] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:48:57 2021] POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:58.393967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:58.395635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:58.401757 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-a8a706a8-8009-4b21-8bfd-593860a6b79a req-e01b82b1-04db-4c21-a2a1-f6e14b85ac72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1219c4a2-cb56-4f49-bb5e-6da279f573b9", "tag": "07e4c4a6-639b-4da1-8b31-c75191903b37"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:58.408016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:58.408016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:58.409870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.410331 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.411137 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.413955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.458597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-a8a706a8-8009-4b21-8bfd-593860a6b79a req-e01b82b1-04db-4c21-a2a1-f6e14b85ac72 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.460516 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-a8a706a8-8009-4b21-8bfd-593860a6b79a req-e01b82b1-04db-4c21-a2a1-f6e14b85ac72 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.498273 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-a8a706a8-8009-4b21-8bfd-593860a6b79a req-e01b82b1-04db-4c21-a2a1-f6e14b85ac72 service nova] Creating event network-changed:07e4c4a6-639b-4da1-8b31-c75191903b37 for instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 on hv-cinder-76845 Nov 22 13:48:58.506109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-a8a706a8-8009-4b21-8bfd-593860a6b79a req-e01b82b1-04db-4c21-a2a1-f6e14b85ac72 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114416 Nov 22 13:48:58.508184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 420/808] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:58.516766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-f56051de-60be-499f-a6ad-0ecdc297cf50 req-1a109eee-b607-4126-b7bd-93eb301c7317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:58.520122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:48:58.520122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:48:58.531478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-f56051de-60be-499f-a6ad-0ecdc297cf50 req-1a109eee-b607-4126-b7bd-93eb301c7317 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.532182 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-f56051de-60be-499f-a6ad-0ecdc297cf50 req-1a109eee-b607-4126-b7bd-93eb301c7317 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.548531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-f56051de-60be-499f-a6ad-0ecdc297cf50 req-1a109eee-b607-4126-b7bd-93eb301c7317 service nova] Creating event network-changed:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:48:58.555465 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-f56051de-60be-499f-a6ad-0ecdc297cf50 req-1a109eee-b607-4126-b7bd-93eb301c7317 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045521 Nov 22 13:48:58.556489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 421/809] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:48:58.563130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:58.564114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:58.598905 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.603113 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.606286 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.606975 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.856883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:58.870254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-904c0cb9-05b3-479f-b588-b3d8d01455e0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1758 microversion: 2.1 time: 0.479476 Nov 22 13:48:58.878602 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 389/810] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:58 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1758 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:48:58.907843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:58.909977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:58.920879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.921711 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.922780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:58.923354 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:58.951672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:48:58.959391 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7ff72c67-c23d-4bb6-8a48-a80f9ffb00e7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.401481 Nov 22 13:48:58.961838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 422/811] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:58 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:48:59.014148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0b96c5ec-bd5d-4094-8b85-93df0ab5088b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.110733 Nov 22 13:48:59.015994 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 390/812] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:48:58 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:48:59.208995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:48:59.210766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:59.221265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:59.222494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:59.224192 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:59.225675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:59.306199 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ddd22346-659a-4674-b3d7-7dd103d16502 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 38348 microversion: 2.20 time: 0.100703 Nov 22 13:48:59.307832 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 423/813] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:48:59 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 38348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:48:59.979509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:48:59.980388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:48:59.987635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:59.988083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:48:59.988875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:48:59.989335 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.026933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:00.027938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:00.035959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.036417 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.037267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.037718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.108301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e19350a0-8a68-4f49-a1ad-19e1e4735f06 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.085678 Nov 22 13:49:00.108939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 424/814] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:00 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:49:00.135392 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:00.143285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bb514c45-f61c-48d6-8bf8-b53255eb9504 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.169626 Nov 22 13:49:00.143861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 391/815] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:48:59 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:00.319856 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:00.320852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:00.328426 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.328872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.329675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.330109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.404390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f3ab1531-23ea-4943-8f41-e46625e13392 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 200 len: 38355 microversion: 2.20 time: 0.088304 Nov 22 13:49:00.404921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 425/816] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:49:00 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 38355 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:49:00.414576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:00.415073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:00.421433 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.421889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.422670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.423110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.446865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1dd1d2ad-d97b-4bda-88b4-51dd66e85707 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/ips" status: 200 len: 152 microversion: 2.20 time: 0.035993 Nov 22 13:49:00.447960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 392/817] 10.222.0.31 () {60 vars in 1288 bytes} [Mon Nov 22 13:49:00 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:00.527892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-6639bfb9-55c8-49b4-b3cd-7dc61bcf628f req-025cd401-18db-454e-8edb-1adab7898401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee44f9f7-0e5d-4b71-812f-45aa270dd3c9", "tag": "888d1f24-4a64-414c-ad37-27c5acf7246d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:00.529519 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:00.529519 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:49:00.537153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6639bfb9-55c8-49b4-b3cd-7dc61bcf628f req-025cd401-18db-454e-8edb-1adab7898401 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:00.537621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6639bfb9-55c8-49b4-b3cd-7dc61bcf628f req-025cd401-18db-454e-8edb-1adab7898401 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:00.548085 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-6639bfb9-55c8-49b4-b3cd-7dc61bcf628f req-025cd401-18db-454e-8edb-1adab7898401 service nova] Creating event network-changed:888d1f24-4a64-414c-ad37-27c5acf7246d for instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 on hv-cinder-76845 Nov 22 13:49:00.552752 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-6639bfb9-55c8-49b4-b3cd-7dc61bcf628f req-025cd401-18db-454e-8edb-1adab7898401 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029361 Nov 22 13:49:00.553537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 426/818] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:49:01.118955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:01.120785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:01.127875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:01.128329 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:01.129131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:01.129622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:01.160049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:01.160623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:01.168247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:01.168704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:01.169544 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:01.169983 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:01.189465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ad99462a-a7d0-4533-bddd-8bc0c9784f41 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.073937 Nov 22 13:49:01.190850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 393/819] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:01 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:49:01.308795 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:01.315968 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2e176933-2a83-48b2-8744-9d0ecb65d347 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.159926 Nov 22 13:49:01.316526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 427/820] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:01 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:02.201147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:02.202193 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:02.208966 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.209444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.210220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.210659 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.268154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-81e12121-fa14-4751-9bad-3a9c23be18d6 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.071507 Nov 22 13:49:02.268756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 394/821] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:02 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:49:02.332852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:02.333459 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:02.339811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.340257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.341031 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.341496 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.473261 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:02.481029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a0f18695-2e47-4afb-92ac-1efdd13acda5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.151958 Nov 22 13:49:02.481617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 428/822] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:02 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:02.678928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:02.679563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:02.686559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.687005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.687776 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.688210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.710877 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lazy-loading 'flavor' on Instance uuid 1d5dba29-802d-4100-bda9-b5f5ce333fce {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:49:02.964434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-de5bd0fc-db3b-40bd-ac69-6fdc488737c1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 202 len: 0 microversion: 2.20 time: 0.289273 Nov 22 13:49:02.965163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 395/823] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:49:02 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:49:02.972848 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:02.973517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:02.980101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.980552 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:02.981382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:02.981859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:03.117702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:03.125438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:03.126933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:03.128333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7e9b8043-a1e0-4984-a528-dc9a2524216d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.159104 Nov 22 13:49:03.128900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 429/824] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:02 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:03.279559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:03.280477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:03.286648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:03.287096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:03.287880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:03.288318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:03.347960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ca5f14c1-fdf7-455a-99f4-1af3b3207bc7 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.073492 Nov 22 13:49:03.348564 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 396/825] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:03 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:49:03.497314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:03.497921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:03.504689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:03.505143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:03.505951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:03.506385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:03.637725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:03.645193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c566dc20-cb71-4ccf-a31e-30fb435c5f73 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.151534 Nov 22 13:49:03.645774 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 430/826] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:03 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:04.147081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:04.147782 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:04.154673 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.155124 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.155901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.156337 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.289958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:04.298171 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:04.299659 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:04.300808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-eda86f55-ed3e-4174-8b45-fe3d4ba974eb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.157782 Nov 22 13:49:04.301394 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 397/827] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:04 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:04.359821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:04.360727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:04.366553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.367011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.367793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.368234 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.426061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-50ad7a4c-0323-4e98-8fc7-277a60205a7a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.069789 Nov 22 13:49:04.426667 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 431/828] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:04 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:49:04.661585 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:04.662201 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:04.669428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.669879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.670658 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:04.671099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:04.806036 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:04.813301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5600dadd-1fb3-4721-a1c2-f3278bc0706e tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.155333 Nov 22 13:49:04.813876 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 398/829] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:04 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:05.319310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:05.320009 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:05.327790 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.328257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.329043 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.329515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.436270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:05.437257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:05.443466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.443912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.444699 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.445150 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.463259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:05.471371 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:05.472967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:05.474152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1191bfc4-c6c8-4e1c-b8c1-83b5c3ab2f42 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.158952 Nov 22 13:49:05.474779 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 432/830] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:05 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:05.516977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a291f069-0c62-4e22-98e1-07424387dde3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.084724 Nov 22 13:49:05.517706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 399/831] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:05 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:49:05.831000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:05.831689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:05.839126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.839581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.840366 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:05.840805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:05.974441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:05.981688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f88df454-1e85-46b0-9ec1-b053e17f62f2 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.154877 Nov 22 13:49:05.982233 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 433/832] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:05 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:06.493020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:06.493767 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:06.500713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:06.501163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:06.501972 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:06.502433 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:06.527362 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:06.528280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:06.534560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:06.535021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:06.535805 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:06.536252 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:06.598881 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a579b20e-7d2f-4e84-8e61-81d9356b2388 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.075559 Nov 22 13:49:06.601397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 434/833] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:06 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:49:06.638468 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:06.646009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:06.647479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:06.648620 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7c2a0a17-9edb-48d8-98ba-95c5e4f48cb5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.159676 Nov 22 13:49:06.649174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 400/834] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:06 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:06.999422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:07.000120 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:07.007225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.007690 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.008446 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.008879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.143021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:07.150494 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c512a2ec-32da-4240-94c1-b989c3979e56 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.155056 Nov 22 13:49:07.151212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 435/835] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:06 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:07.609679 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:07.610627 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:07.616912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.617476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.618300 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.618732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.667206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:07.667814 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:07.673890 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.674338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.675125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:07.675555 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:07.683384 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a76eb9d0-b608-4f1c-9528-0c7a1b4f64c1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 14 microversion: 2.1 time: 0.077222 Nov 22 13:49:07.684021 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 401/836] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:07 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:49:07.808683 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:07.816336 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:07.817872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:07.819019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-97942d65-6c86-4008-819a-e71fcacd7dc4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.156155 Nov 22 13:49:07.819576 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 436/837] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:07 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:08.167666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:08.168357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:08.175396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.175852 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.176645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.177083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.308976 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:08.316750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-142b2018-f83e-4e38-9f19-b70e7f40dc5a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.153218 Nov 22 13:49:08.317342 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 402/838] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:08 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:08.694360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:08.695282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:08.701561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.702020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.702804 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.703244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.784053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-775589f0-567f-4f61-a0fc-5a2f49a0581b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 7357 microversion: 2.1 time: 0.093437 Nov 22 13:49:08.784670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 437/839] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:08 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 7357 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:08.837814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:08.838689 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:08.845046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.845523 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.846295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:08.846723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:08.974220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:08.982955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:08.984459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:08.985661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a6b6b0e4-d171-443d-8134-ddd338ea20b7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.151586 Nov 22 13:49:08.986228 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 403/840] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:08 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:09.229142 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-7d6dbb9d-0a52-49ba-8ad6-a8dc33d62557 req-911f8d8a-405b-465e-82c5-d30097e6ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219c4a2-cb56-4f49-bb5e-6da279f573b9", "name": "network-vif-plugged", "status": "completed", "tag": "07e4c4a6-639b-4da1-8b31-c75191903b37"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:09.230810 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:09.230810 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:49:09.239121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7d6dbb9d-0a52-49ba-8ad6-a8dc33d62557 req-911f8d8a-405b-465e-82c5-d30097e6ded7 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:09.239582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7d6dbb9d-0a52-49ba-8ad6-a8dc33d62557 req-911f8d8a-405b-465e-82c5-d30097e6ded7 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:09.252860 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-7d6dbb9d-0a52-49ba-8ad6-a8dc33d62557 req-911f8d8a-405b-465e-82c5-d30097e6ded7 service nova] Creating event network-vif-plugged:07e4c4a6-639b-4da1-8b31-c75191903b37 for instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 on hv-cinder-76845 Nov 22 13:49:09.257708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-7d6dbb9d-0a52-49ba-8ad6-a8dc33d62557 req-911f8d8a-405b-465e-82c5-d30097e6ded7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Nov 22 13:49:09.258306 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 438/841] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:09.334068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:09.334693 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:09.341665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:09.342117 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:09.342906 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:09.343347 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:09.480254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:09.487697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-18a41ee7-e754-4d29-85a9-7992664b99af tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.157279 Nov 22 13:49:09.488265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 404/842] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:09 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:09.796940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:09.797885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:09.803980 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:09.804432 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:09.805230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:09.805675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:09.883252 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-4a62a94d-9248-4729-8600-cc6d29ac1ab3 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 15025 microversion: 2.1 time: 0.090846 Nov 22 13:49:09.883885 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 439/843] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:09 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 15025 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:10.003872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:10.004479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:10.011749 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.012194 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.012963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.013418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.142752 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:10.150981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:10.152448 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:10.153608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-afc3eef3-9886-4729-ae5f-bead378788fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.153695 Nov 22 13:49:10.154167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 405/844] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:09 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:10.505029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:10.506222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:10.513583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.514037 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.514817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.515259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.649912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:10.663039 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-44120cac-a96e-485e-b8a7-f0e9731e6b1d tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1266 microversion: 2.1 time: 0.162803 Nov 22 13:49:10.663974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 440/845] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:10 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:10.894159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:10.895079 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:10.900926 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.901415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.902200 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:10.902675 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:10.980425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e0a9eb06-788b-45f2-9a92-bd2125f6c6a0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 18003 microversion: 2.1 time: 0.089667 Nov 22 13:49:10.980967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 406/846] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:10 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 18003 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:11.171967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:11.172487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:11.178989 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.179445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.180235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.180675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.314053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:11.321705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:11.324298 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:11.325491 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2af65a72-b6d1-4537-b048-a6c8df9b71e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.157246 Nov 22 13:49:11.326055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 441/847] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:11 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:11.681224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:11.682136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:11.689003 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.689492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.690275 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.690716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.826346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:11.834098 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-92865102-0cbb-478b-a9ea-cc15155363c1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1453 microversion: 2.1 time: 0.156813 Nov 22 13:49:11.834616 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 407/848] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:11 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:11.850237 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:11.850841 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:11.857531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.858015 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.858797 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.859225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.988628 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:11.990879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:11.991790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:11.996468 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-692cbc2a-3127-4754-8185-66ca1d2ee00b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1453 microversion: 2.1 time: 0.149820 Nov 22 13:49:11.997248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 442/849] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:11 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:11.998526 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:11.998972 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:11.999747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:12.000175 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:12.079440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8b77585b-dd1c-4387-8cc4-d6d615978175 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 19342 microversion: 2.1 time: 0.091974 Nov 22 13:49:12.083166 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 408/850] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:11 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 19342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:12.344228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:12.344839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:12.350758 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:12.351217 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:12.352005 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:12.352448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:12.496080 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:12.504391 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:12.505907 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:12.507300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-177a8635-4f0d-454d-a5d6-770a85f926d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.166915 Nov 22 13:49:12.508044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 443/851] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:12 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:13.090768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:13.091758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:13.107720 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:13.108081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:13.108866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:13.109328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:13.207910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a0b5d3e5-41e1-434b-a25e-b782e0cbfeae tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 21674 microversion: 2.1 time: 0.121264 Nov 22 13:49:13.209414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 409/852] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:13 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 21674 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:13.526609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:13.527200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:13.533495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:13.533944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:13.534718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:13.535151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:13.691090 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:13.699480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:13.705390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-278aad11-24a1-46c7-a8df-08ae23b0b418 req-df4b3227-00ac-41aa-b3cc-93776c210af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1219c4a2-cb56-4f49-bb5e-6da279f573b9", "tag": "07e4c4a6-639b-4da1-8b31-c75191903b37"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:13.707122 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:13.707271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:13.707271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:49:13.708442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b07284d7-028f-4dae-a921-c5cb531b43d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.186096 Nov 22 13:49:13.709073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 444/853] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:13 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:13.721037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-278aad11-24a1-46c7-a8df-08ae23b0b418 req-df4b3227-00ac-41aa-b3cc-93776c210af1 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:13.721602 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-278aad11-24a1-46c7-a8df-08ae23b0b418 req-df4b3227-00ac-41aa-b3cc-93776c210af1 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:13.732591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-278aad11-24a1-46c7-a8df-08ae23b0b418 req-df4b3227-00ac-41aa-b3cc-93776c210af1 service nova] Creating event network-changed:07e4c4a6-639b-4da1-8b31-c75191903b37 for instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 on hv-cinder-76845 Nov 22 13:49:13.737421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-278aad11-24a1-46c7-a8df-08ae23b0b418 req-df4b3227-00ac-41aa-b3cc-93776c210af1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103405 Nov 22 13:49:13.738105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 410/854] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:49:14.219563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:14.220576 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:14.226770 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:14.227822 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:14.228844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:14.229848 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:14.311139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-51b65ded-5a23-462f-b6e5-20b345042f87 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 22981 microversion: 2.1 time: 0.095084 Nov 22 13:49:14.314905 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 445/855] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:14 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 22981 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:14.727004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:14.727698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:14.733821 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:14.734263 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:14.735030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:14.735459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:14.866405 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:14.874895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:14.876438 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:14.877870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4c258445-ab8b-4256-82a2-3789bba4069a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1745 microversion: 2.20 time: 0.155174 Nov 22 13:49:14.878424 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 411/856] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:14 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:15.323034 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:15.324218 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:15.331181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:15.331710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:15.332512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:15.332957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:15.411810 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-42d75f54-533a-4d28-a23b-362b2ad9ba25 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 23235 microversion: 2.1 time: 0.092797 Nov 22 13:49:15.416098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 446/857] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:15 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 23235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:15.897147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:15.897791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:15.904255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:15.904704 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:15.905567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:15.906005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:16.039347 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:16.049780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:16.051410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:16.052490 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d33b7490-b1a4-4fca-8869-8734c8ceb3a1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.159401 Nov 22 13:49:16.053042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 412/858] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:15 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:16.424508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:16.425461 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:16.440751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:16.441510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:16.442738 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:16.443287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:16.523843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-da250812-b3e7-46b5-9733-73eaf2b7d945 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 23804 microversion: 2.1 time: 0.103275 Nov 22 13:49:16.528340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 447/859] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:16 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 23804 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:17.071400 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:17.072898 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:17.079850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:17.080309 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:17.081114 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:17.082174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:17.242084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:17.251219 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:17.253075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:17.254440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f3ebda73-293b-48ed-96cd-0d70a745322c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.186553 Nov 22 13:49:17.265571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 413/860] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:17 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:17.387475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-51c1cc1c-f918-4edd-a24a-00306fac0bd4 req-9983074c-a366-493b-b478-6d03d9bb99b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "name": "network-vif-plugged", "status": "completed", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:17.389903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:17.389903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:49:17.399688 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-51c1cc1c-f918-4edd-a24a-00306fac0bd4 req-9983074c-a366-493b-b478-6d03d9bb99b4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:17.400328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-51c1cc1c-f918-4edd-a24a-00306fac0bd4 req-9983074c-a366-493b-b478-6d03d9bb99b4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:17.411338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-51c1cc1c-f918-4edd-a24a-00306fac0bd4 req-9983074c-a366-493b-b478-6d03d9bb99b4 service nova] Creating event network-vif-plugged:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:49:17.417248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-51c1cc1c-f918-4edd-a24a-00306fac0bd4 req-9983074c-a366-493b-b478-6d03d9bb99b4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112505 Nov 22 13:49:17.418181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 448/861] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:17.535911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:17.536824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:17.547209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:17.547666 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:17.548469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:17.548912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:17.639639 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-49ad8b70-dc54-42e6-970d-a60eacc12741 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 24969 microversion: 2.1 time: 0.107196 Nov 22 13:49:17.640452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 414/862] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:17 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 24969 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:18.274386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:18.275758 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:18.283517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:18.284652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:18.285554 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:18.286210 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:18.442443 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:18.452380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:18.455470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:18.456984 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d027df56-e0be-4e68-b4ba-3a2514fdca48 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.187302 Nov 22 13:49:18.458252 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 449/863] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:18 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:18.652784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:18.654471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:18.661925 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:18.662658 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:18.663459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:18.663900 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:18.748472 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-aed9be86-7675-4928-be65-07972f8e6551 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 26247 microversion: 2.1 time: 0.099943 Nov 22 13:49:18.753599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 415/864] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:18 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 26247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:19.475376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:19.477040 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:19.484923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:19.485515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:19.486316 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:19.486780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:19.651832 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:19.663012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:19.664492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:19.666345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3f6a92fb-54d7-4ad6-8dd4-5778442e66c3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.194166 Nov 22 13:49:19.668247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 450/865] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:19 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:19.763103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:19.764151 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:19.771045 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:19.771572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:19.772434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:19.772943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:19.875391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-48e922af-f0b3-4515-914e-13c21ba6dcc4 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 27079 microversion: 2.1 time: 0.117430 Nov 22 13:49:19.876738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 416/866] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:19 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 27079 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:20.685673 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:20.686539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:20.693165 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:20.693724 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:20.694620 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:20.695161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:20.849111 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:20.862537 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:20.864188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:20.865493 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b140005f-a95c-4456-b231-4179216664e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.183556 Nov 22 13:49:20.866189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 451/867] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:20 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:20.888014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:20.889115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:20.897995 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:20.898610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:20.899477 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:20.900535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:21.003950 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c07e7955-3bb7-49fb-aeb3-70e642ab2370 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 27703 microversion: 2.1 time: 0.119920 Nov 22 13:49:21.008011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 417/868] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:20 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 27703 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:21.887285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:21.887285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:21.892773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:21.893265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:21.894055 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:21.894499 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.016665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:22.018356 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:22.027552 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.028410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.029478 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.030316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.036993 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:22.047948 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:22.051598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:22.052772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-47eddc94-71a8-487a-93db-a732f399889c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.171051 Nov 22 13:49:22.063558 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 452/869] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:21 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:22.140906 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8929cd56-ae64-4f59-91c2-cdea0c7d843e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 27997 microversion: 2.1 time: 0.128033 Nov 22 13:49:22.142280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 418/870] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:22 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 27997 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:22.532267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:22.533382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:22.539910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.541027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.542302 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.542817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.629801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-34bb8172-9ef0-4aa6-8d3c-9b3fe08f34ea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action" status: 202 len: 0 microversion: 2.1 time: 0.100931 Nov 22 13:49:22.633694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 453/871] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:22 2021] POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:49:22.639494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:22.640203 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:22.649046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.650283 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.652599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:22.654035 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:22.838565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:22.848554 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f4983f9a-c546-4230-80cd-b0f933cc6b1f tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1750 microversion: 2.1 time: 0.212883 Nov 22 13:49:22.856046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 419/872] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:22 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:23.072661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:23.074230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:23.081124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.081960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:23.084130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.084130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:23.153782 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:23.155796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:23.162116 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.162823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:23.163836 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.164346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:23.262948 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-81f135aa-ef88-4990-a562-bfd7a859da6a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28251 microversion: 2.1 time: 0.114599 Nov 22 13:49:23.268421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 420/873] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:23 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28251 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:23.305129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:23.316126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:23.323405 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:23.324646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-53feb6cd-0a8f-4be4-a257-f1f7051e861e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.256653 Nov 22 13:49:23.325246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 454/874] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:23 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:23.867784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:23.869967 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:23.877878 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.878327 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:23.879117 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:23.879605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:24.049305 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:24.059391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0948529d-0ecb-43a8-a8b8-7d6aa284fa82 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.196169 Nov 22 13:49:24.069680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 421/875] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:23 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:24.276010 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:24.276966 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:24.284011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:24.284476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:24.285488 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:24.285940 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:24.343343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:24.343894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:24.350191 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:24.351568 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:24.352742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:24.353514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:24.354754 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e3a7d40d-dbaf-4f29-8650-60605b737c44 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28251 microversion: 2.1 time: 0.082901 Nov 22 13:49:24.355806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 455/876] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:24 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:24.535233 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:24.544279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:24.545832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:24.547010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e594f6f0-1114-4264-b1c6-7d098d91f21f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.207491 Nov 22 13:49:24.547577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 422/877] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:24 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:25.079350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:25.079974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:25.088396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.088863 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.089723 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.090223 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.241710 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:25.250109 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-683c797c-3237-40be-b8a9-83237af991b8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.174961 Nov 22 13:49:25.250673 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 456/878] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:25 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:25.366130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:25.367054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:25.374211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.374659 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.375465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.375899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.456783 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-90873ab7-018b-4595-bfeb-71114b9285b1 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28542 microversion: 2.1 time: 0.094496 Nov 22 13:49:25.458128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 423/879] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:25 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28542 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:25.565262 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:25.565883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:25.572214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.572666 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.573472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:25.573917 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:25.708152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:25.717877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:25.719492 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:25.720629 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b428b2c3-0784-4895-8ff7-76f6461917ef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1740 microversion: 2.20 time: 0.159145 Nov 22 13:49:25.721181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 457/880] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:25 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:26.267414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:26.268107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:26.275619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.276071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.276855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.277323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.426498 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:26.434240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cc465833-e7a4-4f51-a308-8be8bc2078a8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.170832 Nov 22 13:49:26.434803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 424/881] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:26 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:26.468250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:26.469239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:26.475422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.475871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.476649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.477089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.550581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f626ad2d-2968-4cfd-8750-154169dde35a tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28542 microversion: 2.1 time: 0.085798 Nov 22 13:49:26.551382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 458/882] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:26 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28542 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:26.739211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:26.739822 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:26.746124 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.746564 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.747388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:26.747823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:26.880613 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:26.888898 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:26.890411 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:26.891542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-85e01754-98bc-4f62-abfa-c9e6c46ce1ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1722 microversion: 2.20 time: 0.156040 Nov 22 13:49:26.892100 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 425/883] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:26 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:27.451367 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:27.452087 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:27.459073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.459527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:27.460296 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.460726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:27.562551 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:27.563460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:27.569732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.570176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:27.570955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.571387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:27.608418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:27.616400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-eb2f738e-8a1e-4479-bc8f-1ed0cfedc8c2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.169346 Nov 22 13:49:27.616958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 459/884] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:27 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:27.651543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c9006697-ec94-43a0-904d-259ef3f990c0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28710 microversion: 2.1 time: 0.091889 Nov 22 13:49:27.652286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 426/885] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:27 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28710 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:27.910126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:27.910761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:27.917681 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.918124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:27.918892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:27.919323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:28.047069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:28.054812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:28.056287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:28.057512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8f13fb06-d963-42b2-bd0e-112f12432b5d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1722 microversion: 2.20 time: 0.151284 Nov 22 13:49:28.058252 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 460/886] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:27 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:28.634265 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:28.634959 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:28.641891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:28.642338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:28.643112 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:28.643543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:28.663534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:28.664512 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:28.672096 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:28.672547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:28.673378 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:28.673821 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:28.741833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-962a83ba-5c93-43fd-a9eb-41b091ad11a5 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28710 microversion: 2.1 time: 0.081773 Nov 22 13:49:28.746177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 461/887] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:28 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28710 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:28.788414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:28.796198 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-98c7fe3f-2c61-4f88-b45f-aeacf2555f76 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.165966 Nov 22 13:49:28.796756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 427/888] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:28 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:29.076627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:29.077363 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.084157 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.084614 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.085440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.085883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.217509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.225769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.227271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.228420 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cb694575-1ca0-47a3-a545-711b28654554 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1665 microversion: 2.20 time: 0.156461 Nov 22 13:49:29.228988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 462/889] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:29 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:29.246626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bdd7cda-cb58-46b4-8f27-31a2364fa0a5"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:29.247754 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.254286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.254755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.255529 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.255960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.528262 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-79dfdc24-6856-44c6-a653-78f6c282ba8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286244 Nov 22 13:49:29.528886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 428/890] 10.222.0.31 () {62 vars in 1363 bytes} [Mon Nov 22 13:49:29 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:29.635642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:29.636411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.642689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.643145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.643924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.644361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.740694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f984b58b-480b-46f4-91d8-83117b064fbd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action" status: 202 len: 0 microversion: 2.20 time: 0.109277 Nov 22 13:49:29.741456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 463/891] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:49:29 2021] POST /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:49:29.750104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:29.750718 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.754263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:29.754799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.758682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.759341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.760881 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.761674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.762166 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.762818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.763619 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.764060 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.836992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e8d15381-2359-41ae-a0c9-3b4c640d0f2b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28710 microversion: 2.1 time: 0.086868 Nov 22 13:49:29.838269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 464/892] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:29 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28710 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:49:29.843709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:29.844406 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:29.851022 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.851483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.852271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:29.853570 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:29.911456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.920463 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.921986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:29.923144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-deffeca4-be08-48f9-af59-1312b802014a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1751 microversion: 2.20 time: 0.177067 Nov 22 13:49:29.923708 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 429/893] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:29 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:30.022546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:30.031472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3049ca70-b3ff-4b97-9d0a-29a56174fcea tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.191880 Nov 22 13:49:30.032137 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 465/894] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:29 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:30.849511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:30.850492 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:30.857037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:30.857511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:30.858284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:30.858715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:30.923565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c16d745c-8f30-493f-9091-2844f2d3c32f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 28710 microversion: 2.1 time: 0.077372 Nov 22 13:49:30.924086 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 430/895] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:30 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 28710 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:30.941626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:30.942235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:30.949057 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:30.949530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:30.950310 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:30.950748 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:31.048871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:31.049594 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:31.056597 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:31.057695 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:31.058726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:31.059324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:31.106160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:31.114971 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:31.116285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:31.117481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-7c38443f-fb4d-4785-bf76-ecc3f9bad0ca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1753 microversion: 2.20 time: 0.179471 Nov 22 13:49:31.118238 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 466/896] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:30 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:31.211119 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:31.222848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ade53345-2131-467f-b4eb-d6815cf67865 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.177978 Nov 22 13:49:31.223513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 431/897] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:31 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:31.286239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-5f6e60ab-386e-4833-b017-433ffcaf5173 req-eb41744b-0825-4f19-8136-24b6e61a0aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "name": "network-vif-unplugged", "status": "completed", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:31.288021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:31.288021 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:49:31.297428 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f6e60ab-386e-4833-b017-433ffcaf5173 req-eb41744b-0825-4f19-8136-24b6e61a0aaf service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:31.298129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f6e60ab-386e-4833-b017-433ffcaf5173 req-eb41744b-0825-4f19-8136-24b6e61a0aaf service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:31.310599 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-5f6e60ab-386e-4833-b017-433ffcaf5173 req-eb41744b-0825-4f19-8136-24b6e61a0aaf service nova] Creating event network-vif-unplugged:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:49:31.315522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-5f6e60ab-386e-4833-b017-433ffcaf5173 req-eb41744b-0825-4f19-8136-24b6e61a0aaf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033068 Nov 22 13:49:31.316178 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 467/898] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:49:31.935099 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:31.936091 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:31.942382 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:31.942833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:31.943617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:31.944056 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:32.031899 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c3b403c5-eb2d-4710-8529-d92e8d0c1e85 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 29269 microversion: 2.1 time: 0.100244 Nov 22 13:49:32.035808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 432/899] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:31 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 29269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:32.139780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:32.140479 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:32.146396 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:32.146848 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:32.147626 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:32.148066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:32.241078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:32.241803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:32.249516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:32.249966 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:32.250812 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:32.251167 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:32.325061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:32.334012 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:32.335785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:32.337129 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bd716231-04ca-4279-b3db-5b2cb38e3275 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.202822 Nov 22 13:49:32.338066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 468/900] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:32 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:32.401983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:32.410074 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-21154c9f-79f4-4567-8cad-46674358efe1 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.172957 Nov 22 13:49:32.410655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 433/901] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:32 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:33.045888 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:33.047260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:33.053677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.054118 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.054923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.055360 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.355539 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:33.356201 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:33.362725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.363295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.364188 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.364732 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.506790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:33.515814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:33.517321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:33.518474 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2ef0efd5-c4b1-4396-975f-a6184bc64c78 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.166848 Nov 22 13:49:33.519032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 434/902] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:33 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:33.523347 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:33.523949 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:33.530422 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.530873 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.531679 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:33.532109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:33.919608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:33.927276 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-64ba8e8e-18a1-41b5-841c-78b823942b69 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.407289 Nov 22 13:49:33.927842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 435/903] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:33 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:34.536831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:34.537511 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:34.544281 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:34.544726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:34.545525 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:34.545956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:34.682530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:34.690743 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:34.692236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:34.693417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5b671233-0761-4208-b9db-bb51813dcda2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.160222 Nov 22 13:49:34.693986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 436/904] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:34 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:34.946235 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:34.947020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:34.961017 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:34.961496 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:34.962321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:34.962756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:35.144629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:35.154509 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-505ba27e-1456-4ac8-814e-f428b44b2e1a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.212995 Nov 22 13:49:35.155213 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 437/905] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:34 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:35.711825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:35.712648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:35.720621 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:35.721078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:35.721895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:35.722334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:35.899124 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:35.908119 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:35.909641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:35.910833 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-01c84d17-3eb5-4cac-81c0-0c0cff4e42c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.202751 Nov 22 13:49:35.911740 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 438/906] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:35 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:36.173264 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:36.173879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:36.179953 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:36.180401 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:36.181176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:36.181632 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:36.334850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:36.343277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3ac17e4b-f4af-46f1-b27e-ca0795398e8e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.173882 Nov 22 13:49:36.343837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 439/907] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:36 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:36.929366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:36.930854 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:36.937656 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:36.938278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:36.939291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:36.940095 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:37.085952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:37.097009 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:37.098548 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:37.099718 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-29aa9ec8-b9fb-44f5-9716-6ca4669c349e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.174196 Nov 22 13:49:37.100557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 440/908] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:36 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:37.360811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:37.361373 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:37.367204 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:37.367654 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:37.368435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:37.368871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:37.518488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:37.528221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0dbad9af-d8b9-48c6-ba86-3b30c02a7924 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.171026 Nov 22 13:49:37.529219 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 441/909] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:37 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:38.119848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:38.121761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:38.129986 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:38.130800 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:38.131918 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:38.132565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:38.287047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:38.296825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:38.298348 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:38.299508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-be7f285c-3f10-4f5b-be62-9131853952ed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.183860 Nov 22 13:49:38.300071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 442/910] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:38 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:38.547562 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:38.548084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:38.554128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:38.554571 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:38.555338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:38.555773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:38.722464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:38.730471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a9dfb6c8-ca2d-4457-b4a5-2f305e8f338b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.186530 Nov 22 13:49:38.731048 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 443/911] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:38 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:39.319603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:39.322180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:39.330138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:39.330682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:39.331559 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:39.332197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:39.494752 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:39.507174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:39.508647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:39.510741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bb8a8665-8a0e-49ec-a3fe-d116c8cd98cd tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.195276 Nov 22 13:49:39.521107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 444/912] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:39 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:39.748460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:39.749075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:39.755379 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:39.755837 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:39.756603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:39.757037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:39.926913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:39.935289 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fd893bf6-47ee-4e5a-927e-a5e2294d8665 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.191252 Nov 22 13:49:39.935847 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 445/913] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:39 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:40.528318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:40.529041 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:40.535138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:40.535576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:40.536342 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:40.536772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:40.667439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:40.675389 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:40.677005 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:40.678185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f405369c-2d1a-410c-9b8b-ac755637625b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.154263 Nov 22 13:49:40.678857 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 446/914] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:40 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:40.957231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:40.957231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:40.978963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:40.980178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:40.981576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:40.982338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:41.171362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:41.179250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-74cfa4f4-7534-416c-8565-343c2e549b28 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.229545 Nov 22 13:49:41.179824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 447/915] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:40 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:41.698855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:41.700153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:41.706186 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:41.706626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:41.707395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:41.707821 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:41.863604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:41.872360 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:41.874810 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:41.876029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2144225d-37f1-459b-834a-0a05fee86e21 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.180837 Nov 22 13:49:41.876599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 448/916] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:41 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:42.196416 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:42.197028 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:42.203785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:42.204240 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:42.205018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:42.205480 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:42.361972 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:42.369835 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c95bc6ed-c080-43cb-a954-e0f6837fc99b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.177047 Nov 22 13:49:42.370417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 449/917] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:42 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:42.895956 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:42.896706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:42.904581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:42.905038 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:42.906038 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:42.906475 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:43.050816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:43.064183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:43.065916 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:43.067298 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-409663be-af2f-44eb-bbd2-a21fedc77b09 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.175666 Nov 22 13:49:43.068408 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 450/918] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:42 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:43.388002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:43.388606 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:43.394535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:43.395006 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:43.395772 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:43.396202 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:43.553842 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:43.562439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-0bac71ab-4115-42e9-88d8-28efc57eaa56 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.178357 Nov 22 13:49:43.563010 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 451/919] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:43 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:44.086350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:44.087112 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:44.093514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:44.093963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:44.094744 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:44.095185 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:44.240183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:44.249081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:44.250636 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:44.251804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-87ea6a1f-7cf4-4564-b208-92856ece7939 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.169345 Nov 22 13:49:44.252655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 452/920] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:44 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:44.578975 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:44.579619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:44.585614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:44.586103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:44.586875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:44.587306 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:44.736857 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:44.745419 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7ec55035-cc6f-48dc-b864-4189d6170a9e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.170186 Nov 22 13:49:44.746033 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 453/921] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:44 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:45.270261 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:45.270964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:45.277179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.277698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:45.278471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.278901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:45.414796 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:45.422925 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:45.424381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:45.425583 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-339171a4-8b33-4c86-bbd4-208e0ec49a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.159059 Nov 22 13:49:45.426145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 454/922] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:45 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:45.514991 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d04e229b-3b9d-4a21-b4b0-a05b6bfea7a2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action" status: 200 len: 38368 microversion: 2.1 time: 12.474415 Nov 22 13:49:45.516847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 469/923] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:49:33 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/action => generated 38368 bytes in 12477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:49:45.525600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:45.526015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:45.532773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.533234 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:45.534013 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.534443 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:45.558342 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ae10236f-2cc2-4e3f-82e5-80ddbd93ca6b tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/ips" status: 200 len: 145 microversion: 2.1 time: 0.036326 Nov 22 13:49:45.559481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 455/924] 10.222.0.31 () {58 vars in 1247 bytes} [Mon Nov 22 13:49:45 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:45.766394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:45.767507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:45.774724 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.775561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:45.776652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:45.777046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:46.012697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:46.020372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-18e31e29-14ce-4ab0-88d7-5d851708b75b tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1755 microversion: 2.1 time: 0.261047 Nov 22 13:49:46.020936 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 470/925] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:45 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:49:46.443598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:46.444237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:46.451223 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:46.451676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:46.452462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:46.452906 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:46.581866 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:46.590335 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:46.591828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:46.592987 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1a5b5cbb-ca0b-4cd9-8bd7-9a987700ce56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.153120 Nov 22 13:49:46.593581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 456/926] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:46 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:46.880960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0b06af-291b-48a0-97ba-e766295ebf44"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:46.882059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:46.888799 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:46.889272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:46.890050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:46.890478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:47.038109 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:47.038726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:47.045428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:47.045887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:47.046686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:47.047129 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:47.119371 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-227ab89e-8538-462e-9290-0764b226a8b2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242244 Nov 22 13:49:47.125598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 471/927] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:49:46 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:47.202232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:47.210671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6592a983-e990-45dc-93c2-c544df5f99bb tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1758 microversion: 2.1 time: 0.176067 Nov 22 13:49:47.211229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 457/928] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:49:47 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:49:47.611696 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:47.612478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:47.618941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:47.619390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:47.620208 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:47.620642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:48.005397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:48.014287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:48.015762 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:48.016911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b6dd24c5-4234-47fa-b6ff-0ca1febbeba7 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.409489 Nov 22 13:49:48.017487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 472/929] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:47 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:49.035324 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:49.035964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:49.042217 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:49.043205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:49.044576 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:49.045471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:49.176470 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:49.185120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:49.186629 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:49.187781 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5608fee1-e3c3-4359-9aa5-ee728109dcea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.156318 Nov 22 13:49:49.188342 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 458/930] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:49 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:50.205818 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:50.206357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:50.212580 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:50.213027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:50.213825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:50.214258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:50.342776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:50.351082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:50.352566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:50.353741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ecece006-ade9-41b7-bd68-5c8e7ecbd1a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.151659 Nov 22 13:49:50.354304 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 473/931] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:50 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:51.371960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:51.372574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:51.379128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:51.379582 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:51.380389 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:51.380851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:51.513105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:51.521101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:51.522610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:51.523740 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6d9f6ae5-7cc7-4895-ac79-04e1b7694b4e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.155884 Nov 22 13:49:51.524301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 459/932] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:51 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:52.543388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:52.544013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:52.550386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:52.550843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:52.551631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:52.552073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:52.682066 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:52.690289 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:52.691766 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:52.692938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-950ea5f9-12f5-41a6-bbb7-ccab78285245 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.154033 Nov 22 13:49:52.693539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 474/933] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:52 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:53.711567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:53.712096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:53.718584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:53.719037 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:53.719816 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:53.720255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:53.858664 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:53.866700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:53.868160 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:53.869348 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b5d9724b-b08c-4dc4-b257-e94a656acfac tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.161526 Nov 22 13:49:53.869891 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 460/934] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:53 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:54.581960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:54.582951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:54.589174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.590276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:54.591063 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.591501 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:54.619945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-49f986f7-8698-4f70-8ec3-b3e162abf4ca tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Nov 22 13:49:54.620497 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 475/935] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:49:54 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:54.630291 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:54.630814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:54.636830 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.637401 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:54.638188 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.638623 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:54.666721 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1cfa2f78-22c7-4d6b-b058-ba803f7021af tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44" status: 200 len: 194 microversion: 2.1 time: 0.040393 Nov 22 13:49:54.667290 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 461/936] 10.222.0.31 () {58 vars in 1412 bytes} [Mon Nov 22 13:49:54 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:54.888271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:54.888908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:54.895274 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.895720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:54.896706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:54.897331 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:55.031399 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:55.039526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:55.041023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:55.042207 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2c2ee4cd-23ac-4437-beb4-3f3757bc17e2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.158308 Nov 22 13:49:55.043274 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 476/937] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:54 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:55.974680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e0ce7d8-6d34-4f11-918e-a1fe2803ad2d"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:55.975903 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:55.982235 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:55.982688 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:55.983469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:55.983908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:56.060959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:56.061605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:56.067581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:56.068029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:56.068817 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:56.069276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:56.210287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:56.219203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:56.220782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:56.221985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5faac9e3-7aab-49ad-ab1c-bf0bd8ce3849 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.165444 Nov 22 13:49:56.222539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 477/938] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:56 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:56.225169 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-28aca64e-3eb3-4355-a28e-2ff3e2f11f4f tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253896 Nov 22 13:49:56.225872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 462/939] 10.222.0.31 () {60 vars in 1322 bytes} [Mon Nov 22 13:49:55 2021] POST /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:49:57.243475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:57.244069 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:57.250578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:57.251023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:57.251796 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:57.252227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:57.395515 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:57.404859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:57.406438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:57.407585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-704c3ee0-bc64-428e-a12b-33f7e22aa167 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.167773 Nov 22 13:49:57.408147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 478/940] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:57 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:49:57.486043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-56b9edf4-6381-4525-8da4-e7b90d0cae64 req-c79134ff-74ad-4657-a011-a445e967f29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "name": "network-vif-plugged", "status": "completed", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:49:57.487563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:49:57.487563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:49:57.497133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-56b9edf4-6381-4525-8da4-e7b90d0cae64 req-c79134ff-74ad-4657-a011-a445e967f29f service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:57.497612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-56b9edf4-6381-4525-8da4-e7b90d0cae64 req-c79134ff-74ad-4657-a011-a445e967f29f service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:57.508476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-56b9edf4-6381-4525-8da4-e7b90d0cae64 req-c79134ff-74ad-4657-a011-a445e967f29f service nova] Creating event network-vif-plugged:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:49:57.514209 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-56b9edf4-6381-4525-8da4-e7b90d0cae64 req-c79134ff-74ad-4657-a011-a445e967f29f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Nov 22 13:49:57.514799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 463/941] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:49:58.425403 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:58.426019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:58.432207 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:58.432659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:58.434301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:58.434749 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:58.581784 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:58.591280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:58.592714 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:58.593929 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c218fcb9-cc5d-48b2-85a2-e8cd623904f9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.172151 Nov 22 13:49:58.594587 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 479/942] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:58 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:49:59.613234 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:49:59.613932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:49:59.620219 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:59.620761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:59.621425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:49:59.621864 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:49:59.758155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:59.767083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:59.768674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:49:59.769943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f832606d-c594-47d9-9175-76f4869d16cc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1809 microversion: 2.20 time: 0.161731 Nov 22 13:49:59.770603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 464/943] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:49:59 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:00.788856 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:00.789434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:00.796453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:00.796911 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:00.797733 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:00.798174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:00.928143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:00.936285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:00.937809 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:00.938953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0f9191f3-b083-496a-a0a6-7f47bd44f535 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1796 microversion: 2.20 time: 0.153919 Nov 22 13:50:00.939510 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 480/944] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:00 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:03.687181 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:03.688103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:03.694387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:03.694843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:03.695630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:03.696068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:03.724947 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-efec1190-66a7-4b1c-a9e8-f7b2c4a40518 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042172 Nov 22 13:50:03.725531 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 465/945] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:50:03 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:03.959033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:03.959571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:03.966502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:03.966947 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:03.967716 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:03.968151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:03.994854 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fbcd53dd-549a-49f5-bbc3-64472f036b38 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44" status: 200 len: 194 microversion: 2.1 time: 0.039614 Nov 22 13:50:03.995447 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 481/946] 10.222.0.31 () {58 vars in 1412 bytes} [Mon Nov 22 13:50:03 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:04.005111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:04.005630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:04.012096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:04.012544 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:04.013356 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:04.013791 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:04.089779 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lazy-loading 'services' on Instance uuid ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:50:04.156859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-98715c4a-15ae-43dd-8155-67663e4231ed tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44" status: 202 len: 0 microversion: 2.1 time: 0.155620 Nov 22 13:50:04.157558 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 466/947] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:50:03 2021] DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/9a0b06af-291b-48a0-97ba-e766295ebf44 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:06.312418 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:06.312928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:06.319041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:06.319489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:06.320258 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:06.320692 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:06.348760 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bec0dcd0-99fd-4c71-8c4b-c84db635b056 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/2e0ce7d8-6d34-4f11-918e-a1fe2803ad2d" status: 200 len: 194 microversion: 2.1 time: 0.040152 Nov 22 13:50:06.349342 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 482/948] 10.222.0.31 () {58 vars in 1412 bytes} [Mon Nov 22 13:50:06 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/2e0ce7d8-6d34-4f11-918e-a1fe2803ad2d => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:06.360152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:06.360722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:06.366807 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:06.367257 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:06.368024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:06.368452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:06.444604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lazy-loading 'services' on Instance uuid ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:50:06.510382 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-381beedd-b4ad-46e6-9039-d4d5a7998161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/2e0ce7d8-6d34-4f11-918e-a1fe2803ad2d" status: 202 len: 0 microversion: 2.1 time: 0.154538 Nov 22 13:50:06.511135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 467/949] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:50:06 2021] DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments/2e0ce7d8-6d34-4f11-918e-a1fe2803ad2d => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:07.662030 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:07.662992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:07.669959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.670412 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.671209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.671641 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.699272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1b0e7c5f-c2c6-453a-883a-1c9fc44574d0 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040891 Nov 22 13:50:07.699812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 483/950] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:50:07 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:50:07.798130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:07.799211 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:07.805232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.805694 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.806484 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.806925 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.835053 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4366f9a5-8429-4566-8378-0f1d7076f978 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041414 Nov 22 13:50:07.835543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 468/951] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:50:07 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 13:50:07.890299 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:07.890793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:07.896633 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.897084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.897896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:07.898329 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:07.922547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:50:07.992482 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6254ce41-641c-45b6-b584-a8a5cd7d8408 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 204 len: 0 microversion: 2.1 time: 0.106253 Nov 22 13:50:07.993058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 484/952] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:50:07 2021] DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:50:08.001131 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:08.001817 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:08.009670 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:08.010132 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:08.011610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:08.012236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:08.146895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:08.154110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1df6d63e-7faf-4fbb-913d-28148b233f96 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1672 microversion: 2.1 time: 0.156641 Nov 22 13:50:08.154680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 469/953] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:07 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:50:09.172300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:09.173011 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:09.179381 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:09.179838 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:09.180631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:09.181072 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:09.315239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:09.322456 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-be067e56-fb45-4fc7-8946-6fe8dd2f21ef tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1672 microversion: 2.1 time: 0.154193 Nov 22 13:50:09.323017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 485/954] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:09 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:10.340076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:10.340641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:10.347452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:10.347902 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:10.348713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:10.349179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:10.482133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb145d6436b45f5a028a84f35522a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b94d04bded4b188291cfa01accf7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:10.489450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-71460bc8-ffe3-44a6-aa7a-87b9bb362c3e tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 200 len: 1672 microversion: 2.1 time: 0.153215 Nov 22 13:50:10.490154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 470/955] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:10 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:10.940280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-ee9e6e2c-4cc4-4ffd-b7a1-6261ac7db0fc req-ef27de76-1955-4856-ba85-216d16d10fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee44f9f7-0e5d-4b71-812f-45aa270dd3c9", "name": "network-vif-deleted", "tag": "888d1f24-4a64-414c-ad37-27c5acf7246d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:10.941862 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:10.941862 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:50:10.950343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-ee9e6e2c-4cc4-4ffd-b7a1-6261ac7db0fc req-ef27de76-1955-4856-ba85-216d16d10fc0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:10.951912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-ee9e6e2c-4cc4-4ffd-b7a1-6261ac7db0fc req-ef27de76-1955-4856-ba85-216d16d10fc0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:10.965703 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-ee9e6e2c-4cc4-4ffd-b7a1-6261ac7db0fc req-ef27de76-1955-4856-ba85-216d16d10fc0 service nova] Creating event network-vif-deleted:888d1f24-4a64-414c-ad37-27c5acf7246d for instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 on hv-cinder-76845 Nov 22 13:50:10.971194 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-ee9e6e2c-4cc4-4ffd-b7a1-6261ac7db0fc req-ef27de76-1955-4856-ba85-216d16d10fc0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101836 Nov 22 13:50:10.978316 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 486/956] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:11.507937 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:11.508664 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:11.515868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:11.516323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:11.517118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:11.517590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:11.532466 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. Nov 22 13:50:11.533064 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:11.533914 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7befd1f9-2794-4781-95f9-4c12fa5d591c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 404 len: 111 microversion: 2.1 time: 0.029901 Nov 22 13:50:11.534462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 471/957] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:11 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:11.543235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e68fb1b8-b1b7-4a7a-87ec-9a514b960ae2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '.version_select at 0x7f673dbe7160>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:11.562278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e68fb1b8-b1b7-4a7a-87ec-9a514b960ae2 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540833308" status: 202 len: 0 microversion: 2.1 time: 0.022968 Nov 22 13:50:11.563058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 487/958] 10.222.0.31 () {58 vars in 1220 bytes} [Mon Nov 22 13:50:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540833308 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:14.489923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:14.490418 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:14.497589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.497784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.498563 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.498994 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.512624 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. Nov 22 13:50:14.513238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:14.514044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d00a6e14-595f-4db5-a3f4-5b125f5f7161 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 404 len: 111 microversion: 2.1 time: 0.027700 Nov 22 13:50:14.514577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 472/959] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:50:14 2021] DELETE /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:14.522783 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:14.523509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: ee44f9f7-0e5d-4b71-812f-45aa270dd3c9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:14.529682 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.530130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.530902 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.531333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.544475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. Nov 22 13:50:14.545053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:14.545899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-edecca71-f1bd-42ad-9cce-6ee48d08fd46 tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9" status: 404 len: 111 microversion: 2.1 time: 0.027241 Nov 22 13:50:14.546440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 488/960] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:14 2021] GET /compute/v2.1/servers/ee44f9f7-0e5d-4b71-812f-45aa270dd3c9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 13:50:14.586013 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:14.586626 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:14.592437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.592889 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.593697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.594133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.622002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lazy-loading 'flavor' on Instance uuid 928c471e-c956-4529-9003-2d16d7499657 {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:50:14.701276 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f2d0972f-942e-4d1d-9bf1-c812003531ba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "POST /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657/action" status: 202 len: 0 microversion: 2.1 time: 0.120131 Nov 22 13:50:14.702042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 473/961] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:50:14 2021] POST /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:14.710075 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:14.710709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:14.716507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.716957 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.717757 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:14.718193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:14.860074 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:14.867652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0cbacd80-fdab-4304-96d6-8df222c1ead6 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.161139 Nov 22 13:50:14.868292 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 489/962] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:14 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:50:15.680107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:15.680720 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:15.687138 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.687586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:15.688366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.689143 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:15.702546 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. Nov 22 13:50:15.703126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:15.703921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-03b86a60-488e-419f-abbd-ba082016e11c tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 404 len: 111 microversion: 2.1 time: 0.028328 Nov 22 13:50:15.704434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 474/963] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:50:15 2021] DELETE /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:15.711948 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:15.712557 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] [instance: 67bbd747-629b-485c-a1b2-e964b23cd5e6] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:15.719591 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.720037 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:15.720795 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.721255 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:15.734393 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] HTTP exception thrown: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. Nov 22 13:50:15.734962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] Returning 404 to user: Instance 67bbd747-629b-485c-a1b2-e964b23cd5e6 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:15.735759 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f8e72fa7-1f27-4012-bd54-ab7a59e386db tempest-AttachVolumeTestJSON-677274602 tempest-AttachVolumeTestJSON-677274602-project] 10.222.0.31 "GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6" status: 404 len: 111 microversion: 2.1 time: 0.027435 Nov 22 13:50:15.736276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 490/964] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:15 2021] GET /compute/v2.1/servers/67bbd747-629b-485c-a1b2-e964b23cd5e6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:15.886024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:15.887369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:15.893184 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.893683 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:15.894505 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:15.894941 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:16.136850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:16.144187 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d1d762eb-4ed3-4838-86fc-d5e8f0b9be0b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.261793 Nov 22 13:50:16.144751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 475/965] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:15 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:17.161809 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:17.162372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:17.169264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:17.170294 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:17.171094 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:17.171538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:17.302825 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:17.310689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-359ef87b-e14d-431c-808e-e7a11cb11f71 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.152618 Nov 22 13:50:17.311257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 491/966] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:17 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:18.327241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:18.328465 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:18.334997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:18.335459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:18.336251 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:18.336859 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:18.495660 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:18.504145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e9027b2e-92ad-45fd-b37e-d84891771f47 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.180868 Nov 22 13:50:18.504717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 476/967] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:18 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:19.522175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:19.522794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:19.529889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:19.530428 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:19.531384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:19.531972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:19.667104 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:19.674672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f5145d3e-f999-4efd-a57c-8992e139044e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.156510 Nov 22 13:50:19.675244 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 492/968] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:19 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:20.691631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:20.692403 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:20.700273 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:20.700784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:20.701605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:20.702039 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:20.835710 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:20.843958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4d663317-d03d-4ff3-a5d5-6509897e4563 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.156009 Nov 22 13:50:20.844600 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 477/969] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:20 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:21.862035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:21.862633 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:21.869330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:21.869790 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:21.870671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:21.871280 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:22.017139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:22.024573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ae1df26e-cd19-4fa6-b84f-f9df13805f3c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.166295 Nov 22 13:50:22.025177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 493/970] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:21 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:23.041706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:23.042323 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:23.049537 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:23.049983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:23.050765 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:23.051196 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:23.185763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:23.193433 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f4227bc2-7e3a-4650-9a4d-af5d4e92fc06 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.155416 Nov 22 13:50:23.194007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 478/971] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:23 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:24.210517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:24.211139 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:24.218309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:24.218759 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:24.219543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:24.219975 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:24.351383 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:24.358561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9d5e55a1-e07b-449e-8cfa-5c1805b69a7a tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.151757 Nov 22 13:50:24.359120 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 494/972] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:24 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:25.375258 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:25.375874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:25.382510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:25.382892 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:25.383709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:25.384144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:25.525614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:25.533664 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-23cdfd90-86ce-48a6-bdbc-ba6800d778eb tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.162080 Nov 22 13:50:25.534237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 479/973] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:25 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:26.550877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:26.551554 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:26.558198 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:26.558759 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:26.559560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:26.560023 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:26.699308 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:26.707473 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-71020281-7107-4e53-8efc-b3514398d120 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.160398 Nov 22 13:50:26.708038 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 495/974] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:26 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:26.794494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-21921982"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:26.795249 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:26.801660 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:26.802299 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:26.803201 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:26.803644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:26.948197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.network.security_group_api [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Removing security group c370e65b-0197-4f66-805f-ce0da72afd56 from port 899b8778-cdd6-4c85-97ba-5ca10edfb816 Nov 22 13:50:27.322992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1dd7b63d-5df2-4672-94fb-3bc17a186c0a tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action" status: 202 len: 0 microversion: 2.1 time: 0.532297 Nov 22 13:50:27.323855 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 480/975] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:50:26 2021] POST /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:27.332781 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-15bb1fb7-3c8a-4dc3-9c62-b821c46dbcb5 req-d3949c6a-d432-4608-a204-82032eede50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:27.334730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:27.334730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:50:27.358330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-15bb1fb7-3c8a-4dc3-9c62-b821c46dbcb5 req-d3949c6a-d432-4608-a204-82032eede50c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:27.358978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-15bb1fb7-3c8a-4dc3-9c62-b821c46dbcb5 req-d3949c6a-d432-4608-a204-82032eede50c service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:27.373506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-15bb1fb7-3c8a-4dc3-9c62-b821c46dbcb5 req-d3949c6a-d432-4608-a204-82032eede50c service nova] Creating event network-changed:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:50:27.380812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-15bb1fb7-3c8a-4dc3-9c62-b821c46dbcb5 req-d3949c6a-d432-4608-a204-82032eede50c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051466 Nov 22 13:50:27.381847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 496/976] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:50:27.725136 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:27.726176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:27.732990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:27.733787 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:27.734824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:27.735496 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:28.118586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:28.126683 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-77a2c63b-1301-495f-8bad-98112467cee1 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.405064 Nov 22 13:50:28.127510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 481/977] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:27 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:28.642998 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:28.643583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:28.650883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:28.651439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:28.652323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:28.652896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:28.735925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lazy-loading 'services' on Instance uuid 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:50:28.814384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f32b5c26-487f-4a2e-b157-3447101214e3 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments/4f9affad-c6ac-49fe-990f-3982c9b3be47" status: 202 len: 0 microversion: 2.1 time: 0.176206 Nov 22 13:50:28.815430 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 497/978] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:50:28 2021] DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments/4f9affad-c6ac-49fe-990f-3982c9b3be47 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:28.826535 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:28.828774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:28.836778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:28.837577 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:28.838936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:28.839784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:28.875014 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b2fccc5d-3759-4796-9186-5cdd7feb2113 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054890 Nov 22 13:50:28.875718 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 482/979] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:50:28 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:29.144712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:29.145641 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:29.152725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.154145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.154959 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.155412 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.321444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:29.330705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f546b570-70af-445f-bec2-9d39a0147868 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.189802 Nov 22 13:50:29.331747 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 498/980] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:29 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:29.399631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-b1ecbd42-68ac-4857-baba-5fdb39fc0a57 req-901b220b-cb61-4a30-96aa-072e09c8fda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:29.404450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:29.404450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:50:29.414989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-b1ecbd42-68ac-4857-baba-5fdb39fc0a57 req-901b220b-cb61-4a30-96aa-072e09c8fda9 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.415432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-b1ecbd42-68ac-4857-baba-5fdb39fc0a57 req-901b220b-cb61-4a30-96aa-072e09c8fda9 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.432522 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-b1ecbd42-68ac-4857-baba-5fdb39fc0a57 req-901b220b-cb61-4a30-96aa-072e09c8fda9 service nova] Creating event network-changed:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:50:29.439905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-b1ecbd42-68ac-4857-baba-5fdb39fc0a57 req-901b220b-cb61-4a30-96aa-072e09c8fda9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044108 Nov 22 13:50:29.440799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 483/981] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:29.886197 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:29.888113 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:29.894944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.895394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.896377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.896813 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.930615 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f37870d4-8a70-490b-9733-d3d7ec1412f2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048272 Nov 22 13:50:29.931470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 499/982] 10.222.0.31 () {58 vars in 1301 bytes} [Mon Nov 22 13:50:29 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 13:50:29.941686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:29.942354 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:29.951341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.952115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:29.953106 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:29.953780 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:30.046434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] HTTP exception thrown: Instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 is not attached to volume 4f9affad-c6ac-49fe-990f-3982c9b3be47 Nov 22 13:50:30.047039 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Returning 404 to user: Instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 is not attached to volume 4f9affad-c6ac-49fe-990f-3982c9b3be47 {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:30.048481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e34c20bb-ab9d-4c92-9fb8-87a2d37699f0 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments/4f9affad-c6ac-49fe-990f-3982c9b3be47" status: 404 len: 154 microversion: 2.1 time: 0.111105 Nov 22 13:50:30.049042 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 484/983] 10.222.0.31 () {58 vars in 1415 bytes} [Mon Nov 22 13:50:29 2021] DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0/os-volume_attachments/4f9affad-c6ac-49fe-990f-3982c9b3be47 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:30.347933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:30.348542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:30.354642 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:30.355585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:30.356742 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:30.357427 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:30.499088 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:30.515578 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8106480a-2ba0-45bf-9b6a-cd483eb56cfd tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.170001 Nov 22 13:50:30.516265 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 500/984] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:30 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:31.206488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:31.206488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:31.211685 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.212133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.212954 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.213391 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.242699 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:50:31.325241 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ee789b56-6e95-4e14-bd5a-b54143f8615d tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 204 len: 0 microversion: 2.1 time: 0.123477 Nov 22 13:50:31.326227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 485/985] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:50:31 2021] DELETE /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:50:31.334230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:31.334847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:31.342328 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.342852 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.343772 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.344206 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.478708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:31.486884 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-916b4de7-f269-4c56-be45-b7de14c7257e tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1554 microversion: 2.1 time: 0.156276 Nov 22 13:50:31.487465 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 501/986] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:31 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:31.533572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:31.534280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:31.539924 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.540376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.541309 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:31.541756 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:31.678301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:31.685882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e034319a-f79d-44b8-aed2-c2cf0eaf3962 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.156269 Nov 22 13:50:31.686444 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 486/987] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:31 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:32.506171 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:32.507386 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:32.515112 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.515994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.516792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.517260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.671888 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:32.680470 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-955d294f-8ea3-4726-87e3-3037e8114df2 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1554 microversion: 2.1 time: 0.177768 Nov 22 13:50:32.681323 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 502/988] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:32 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:32.704761 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:32.705692 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:32.712452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.713078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.714026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.714516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.879839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:32.887452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e8597989-edea-446a-9e4a-5fd522a43d85 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1568 microversion: 2.1 time: 0.187522 Nov 22 13:50:32.888596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 487/989] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:32 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:32.905051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:32.905660 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:32.911264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.911706 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.912480 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:32.912912 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:32.994780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ba86dd60-f086-4278-8933-2580428404e0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "POST /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657/action" status: 202 len: 0 microversion: 2.1 time: 0.094172 Nov 22 13:50:32.997598 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 503/990] 10.222.0.31 () {60 vars in 1277 bytes} [Mon Nov 22 13:50:32 2021] POST /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:33.006335 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:33.013617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:33.020983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:33.025828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:33.026958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:33.027599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:33.201397 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:33.209395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-79ba246d-8b31-4356-9aa0-b67dae5bffaf tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1516 microversion: 2.1 time: 0.208207 Nov 22 13:50:33.210012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 488/991] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:32 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:33.699079 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:33.699816 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:33.706735 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:33.708114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:33.708941 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:33.709408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:33.787400 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347302854280447e84ccf98931967625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdbcd612796433d849fc488aa45a196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:33.803469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d1f25dfa-9585-4e43-8a7c-5e4879a06bdd tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 200 len: 1512 microversion: 2.1 time: 0.108768 Nov 22 13:50:33.804193 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 504/992] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:33 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:33.870075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-5c7f1b4f-aa29-431c-aefa-8fae259b39f7 req-a44ff4a9-e683-451a-beec-3adb55decb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1c54be-7420-4211-bc58-1cbb85a6b0c0", "name": "network-vif-deleted", "tag": "899b8778-cdd6-4c85-97ba-5ca10edfb816"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:33.871650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:33.871650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:50:33.882285 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5c7f1b4f-aa29-431c-aefa-8fae259b39f7 req-a44ff4a9-e683-451a-beec-3adb55decb43 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:33.882580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5c7f1b4f-aa29-431c-aefa-8fae259b39f7 req-a44ff4a9-e683-451a-beec-3adb55decb43 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:33.898357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-5c7f1b4f-aa29-431c-aefa-8fae259b39f7 req-a44ff4a9-e683-451a-beec-3adb55decb43 service nova] Creating event network-vif-deleted:899b8778-cdd6-4c85-97ba-5ca10edfb816 for instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 on hv-cinder-76845 Nov 22 13:50:33.904415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-5c7f1b4f-aa29-431c-aefa-8fae259b39f7 req-a44ff4a9-e683-451a-beec-3adb55decb43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036877 Nov 22 13:50:33.905755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 489/993] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:34.228506 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:34.229469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:34.235895 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:34.236644 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:34.237388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:34.237984 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:34.417800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:34.427321 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0a3209b1-df5b-455e-ada3-3fdd4b0cfdba tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1518 microversion: 2.1 time: 0.203174 Nov 22 13:50:34.427967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 505/994] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:34 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:34.822030 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:34.822735 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] [instance: 6a1c54be-7420-4211-bc58-1cbb85a6b0c0] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:34.829497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:34.829980 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:34.830799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:34.831243 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:34.847255 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] HTTP exception thrown: Instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 could not be found. Nov 22 13:50:34.847765 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Returning 404 to user: Instance 6a1c54be-7420-4211-bc58-1cbb85a6b0c0 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:34.848742 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-48443f1c-633b-43e3-8d3a-1521114939d7 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0" status: 404 len: 111 microversion: 2.1 time: 0.031240 Nov 22 13:50:34.849386 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 490/995] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:34 2021] GET /compute/v2.1/servers/6a1c54be-7420-4211-bc58-1cbb85a6b0c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:50:34.857588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bf111cb0-64af-441c-936d-2716b1a70ae8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] Calling method '.version_select at 0x7f673daaf940>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:34.878923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bf111cb0-64af-441c-936d-2716b1a70ae8 tempest-TestMinimumBasicScenario-458665296 tempest-TestMinimumBasicScenario-458665296-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1522226046" status: 202 len: 0 microversion: 2.1 time: 0.025041 Nov 22 13:50:34.879534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 506/996] 10.222.0.31 () {58 vars in 1271 bytes} [Mon Nov 22 13:50:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1522226046 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:50:35.445369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:35.446043 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:35.452613 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:35.453180 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:35.454170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:35.454737 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:35.671078 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:35.678617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-57d8962a-a680-4c86-8247-5ecff7801c2c tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.237053 Nov 22 13:50:35.679112 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 491/997] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:35 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:36.695421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:36.696054 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:36.702694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:36.703154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:36.703945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:36.704388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:36.969773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:36.977384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6e3ca4aa-8301-406f-bf07-b24b8ad55b6b tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.286286 Nov 22 13:50:36.977951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 507/998] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:36 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:37.574252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-62a40a20-5c67-4b19-82cd-3b0076503b70 req-507790bf-9cb4-408f-93bd-edb4855b8111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "name": "network-vif-unplugged", "status": "completed", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:37.579821 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:37.579821 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:50:37.589856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-62a40a20-5c67-4b19-82cd-3b0076503b70 req-507790bf-9cb4-408f-93bd-edb4855b8111 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:37.590726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-62a40a20-5c67-4b19-82cd-3b0076503b70 req-507790bf-9cb4-408f-93bd-edb4855b8111 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:37.605518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-62a40a20-5c67-4b19-82cd-3b0076503b70 req-507790bf-9cb4-408f-93bd-edb4855b8111 service nova] Creating event network-vif-unplugged:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:50:37.612502 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-62a40a20-5c67-4b19-82cd-3b0076503b70 req-507790bf-9cb4-408f-93bd-edb4855b8111 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044526 Nov 22 13:50:37.614096 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 492/999] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:37.995221 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:37.995989 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:38.003466 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:38.003922 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:38.004717 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:38.005156 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:38.268046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:38.275315 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ef2f5bed-5ef8-4a45-8848-86e3640b432e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.284551 Nov 22 13:50:38.286727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 508/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:37 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:39.294872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:39.295494 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:39.301964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:39.302420 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:39.303210 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:39.303645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:39.505517 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:39.517490 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-40770c64-56c7-45a0-919b-c53ef2fd00d4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.227622 Nov 22 13:50:39.519668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 493/1001] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:39 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:40.400231 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:40.400744 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:40.408181 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.408630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.409489 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.409929 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.442153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1c1e4d53-d3ff-4595-86ca-2e4eae5703c6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments/1bdd7cda-cb58-46b4-8f27-31a2364fa0a5" status: 200 len: 194 microversion: 2.20 time: 0.045893 Nov 22 13:50:40.442789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 509/1002] 10.222.0.31 () {60 vars in 1453 bytes} [Mon Nov 22 13:50:40 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments/1bdd7cda-cb58-46b4-8f27-31a2364fa0a5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:50:40.517189 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:40.518818 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:40.525831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.526282 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.527141 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.527574 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.538390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:40.539803 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:40.547746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.548635 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.550187 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.551017 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.627741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.objects.instance [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lazy-loading 'services' on Instance uuid 1d5dba29-802d-4100-bda9-b5f5ce333fce {{(pid=122684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:50:40.717506 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b3beaf22-1deb-426c-a573-1a4ef1b73e93 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments/1bdd7cda-cb58-46b4-8f27-31a2364fa0a5" status: 202 len: 0 microversion: 2.20 time: 0.208864 Nov 22 13:50:40.718591 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 494/1003] 10.222.0.31 () {60 vars in 1456 bytes} [Mon Nov 22 13:50:40 2021] DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments/1bdd7cda-cb58-46b4-8f27-31a2364fa0a5 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:50:40.726983 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:40.728437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:40.736276 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.736793 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.737713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:40.737843 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:40.738633 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:40.745376 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6a895d15-8ff6-43d0-bd76-60d49deb8802 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.213342 Nov 22 13:50:40.746460 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 510/1004] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:40 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:40.781343 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-abe1cefc-b79a-4c04-bb04-5f0ac4ca4b5f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058230 Nov 22 13:50:40.782358 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 495/1005] 10.222.0.31 () {60 vars in 1342 bytes} [Mon Nov 22 13:50:40 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:50:41.763855 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:41.764581 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:41.771385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.771973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.772846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.773393 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.794671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:41.795957 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:41.803622 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.804028 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.805080 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.805607 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.848775 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f6b6bb49-d843-4abe-8ae6-d05ec079cc94 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059446 Nov 22 13:50:41.849376 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 496/1006] 10.222.0.31 () {60 vars in 1342 bytes} [Mon Nov 22 13:50:41 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:41.916304 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:41.916819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:41.923700 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.924223 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.925369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:41.925883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:41.951381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:50:42.035457 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-37f37feb-4d40-487c-8757-576094a280fa tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 204 len: 0 microversion: 2.20 time: 0.126498 Nov 22 13:50:42.040011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 497/1007] 10.222.0.31 () {60 vars in 1279 bytes} [Mon Nov 22 13:50:41 2021] DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 13:50:42.047303 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:42.048170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:42.056026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:42.056420 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:42.057191 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:42.057669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:42.162264 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:42.171771 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6ddec29c-f5b1-4e61-a32e-d11abb1ed39e tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1574 microversion: 2.1 time: 0.411770 Nov 22 13:50:42.182787 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 511/1008] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:41 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1574 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:42.223774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:42.232462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:42.234680 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:42.236068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dc660d87-a8d2-42b9-ad00-51801e0c6065 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.194567 Nov 22 13:50:42.236832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 498/1009] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:42 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:43.191026 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:43.191638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:43.197859 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:43.198313 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:43.199095 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:43.199526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:43.255566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:43.256174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:43.262870 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:43.263655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:43.264469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:43.264917 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:43.339769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:43.348686 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a7b5a518-8a6a-4140-8900-c4dc561d5ad4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1561 microversion: 2.1 time: 0.160806 Nov 22 13:50:43.352984 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 512/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:50:43 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:50:43.422921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:43.430617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:43.432083 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:43.433245 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fb1a2359-1d97-4bd7-a29c-46fcf7783a31 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.181965 Nov 22 13:50:43.433805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 499/1011] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:43 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:44.453671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:44.454906 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:44.464549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:44.466246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:44.467509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:44.468314 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:44.624704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:44.632928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:44.634535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:44.635773 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-1a8096ce-9bd3-487b-bad8-1d4783201186 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 200 len: 1724 microversion: 2.20 time: 0.187972 Nov 22 13:50:44.636411 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 513/1012] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:44 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:45.028024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-c09eec5d-ef73-4d7c-ad50-9f50b65388f1 req-c3be5e95-4d69-4e3f-a2c8-191b86c3edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5dba29-802d-4100-bda9-b5f5ce333fce", "name": "network-vif-deleted", "tag": "749b155e-552b-4d76-916d-ffc597aeaa75"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:45.031147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:45.031147 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:50:45.040875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-c09eec5d-ef73-4d7c-ad50-9f50b65388f1 req-c3be5e95-4d69-4e3f-a2c8-191b86c3edc5 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:45.041811 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-c09eec5d-ef73-4d7c-ad50-9f50b65388f1 req-c3be5e95-4d69-4e3f-a2c8-191b86c3edc5 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:45.055459 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-c09eec5d-ef73-4d7c-ad50-9f50b65388f1 req-c3be5e95-4d69-4e3f-a2c8-191b86c3edc5 service nova] Creating event network-vif-deleted:749b155e-552b-4d76-916d-ffc597aeaa75 for instance 1d5dba29-802d-4100-bda9-b5f5ce333fce on hv-cinder-76845 Nov 22 13:50:45.063230 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-c09eec5d-ef73-4d7c-ad50-9f50b65388f1 req-c3be5e95-4d69-4e3f-a2c8-191b86c3edc5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038767 Nov 22 13:50:45.065054 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 500/1013] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:45.640945 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-4d560239-fcfa-48ee-ba38-25be7835a532 req-3b747129-6a7e-40b3-8109-be498cd5ec34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "name": "network-vif-plugged", "status": "completed", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:45.643553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:45.643553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:50:45.656910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:45.658088 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:45.658536 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-4d560239-fcfa-48ee-ba38-25be7835a532 req-3b747129-6a7e-40b3-8109-be498cd5ec34 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:45.660404 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-4d560239-fcfa-48ee-ba38-25be7835a532 req-3b747129-6a7e-40b3-8109-be498cd5ec34 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:45.667108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:45.667747 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:45.669495 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:45.670250 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:45.677811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-4d560239-fcfa-48ee-ba38-25be7835a532 req-3b747129-6a7e-40b3-8109-be498cd5ec34 service nova] Creating event network-vif-plugged:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:50:45.685566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-4d560239-fcfa-48ee-ba38-25be7835a532 req-3b747129-6a7e-40b3-8109-be498cd5ec34 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048515 Nov 22 13:50:45.686421 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 514/1014] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:45.689882 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. Nov 22 13:50:45.690698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:50:45.691887 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bba99d2d-0384-4794-8fd4-0654f1f89f8c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 404 len: 111 microversion: 2.20 time: 0.040900 Nov 22 13:50:45.692614 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 501/1015] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:45 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 13:50:45.701553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b10a4ae3-0998-462e-959a-1611b5a0b52d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '.version_select at 0x7f673daaf940>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:45.726453 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b10a4ae3-0998-462e-959a-1611b5a0b52d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607205471" status: 204 len: 0 microversion: 2.20 time: 0.029061 Nov 22 13:50:45.727693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 515/1016] 10.222.0.31 () {60 vars in 1261 bytes} [Mon Nov 22 13:50:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607205471 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 13:50:46.429236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: .version_select at 0x7f673d9368b0>, body: {"keypair": {"name": "tempest-keypair-958490198"}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:46.443975 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:50:46.447686 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:50:46.709905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:50:46.713586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.quota [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'key_pairs'} {{(pid=122684) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:50:46.727638 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a5c23a39-5d93-434b-b507-5986327a9ce8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.302070 Nov 22 13:50:46.728237 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 502/1017] 10.222.0.31 () {62 vars in 1198 bytes} [Mon Nov 22 13:50:46 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 303 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 13:50:48.069357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-73948382", "imageRef": "55f913e6-4767-405a-8873-d9b69333276e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13d33f4b-6ae7-4e77-b7bc-0f018ce37593"}], "security_groups": [{"name": "tempest-securitygroup--2019710509"}], "key_name": "tempest-keypair-958490198", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:48.172357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] validate_networks() for [('13d33f4b-6ae7-4e77-b7bc-0f018ce37593', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:50:48.533727 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:50:48.534155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:50:48.534655 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:50:48.535067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:50:48.535483 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:50:48.544478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:48.544925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:48.545801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:48.546240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:48.562709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:50:48.566605 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Getting quotas for user a8a3fab5efa2467d85df830cf8b70c4b and project 08aa9b67016f4c04b4aaa3c5f141bc04. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:50:48.577167 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:50:48.579685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55f913e6-4767-405a-8873-d9b69333276e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:50:48.628313 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-258691be-4866-43ff-bc86-0c6db9d9dade tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.563641 Nov 22 13:50:48.628995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 516/1018] 10.222.0.31 () {62 vars in 1187 bytes} [Mon Nov 22 13:50:48 2021] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 13:50:48.639499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:48.640116 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:48.697789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:48.704973 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:48.706538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:48.707641 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2716e12b-b559-48e5-a545-fb6b77b01e72 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1279 microversion: 2.20 time: 0.072541 Nov 22 13:50:48.708225 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 503/1019] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:48 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1279 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:50:49.727435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:49.728652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:49.737474 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:49.737926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:49.738721 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:49.739159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:49.803392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:49.812220 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:49.813780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:49.814892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-592507f4-83af-49f0-8bd6-58800b67412f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1337 microversion: 2.20 time: 0.093345 Nov 22 13:50:49.815440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 517/1020] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:49 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:50.833451 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:50.835134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:50.844266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:50.845404 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:50.847148 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:50.848434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:51.123172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-c1cb6f3c-cb29-406c-bb2b-ce63d3787573 req-bb9c0774-3f21-4126-b5c1-8dcc8703d39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:51.140248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:51.140248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:50:51.154701 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-c1cb6f3c-cb29-406c-bb2b-ce63d3787573 req-bb9c0774-3f21-4126-b5c1-8dcc8703d39e service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:51.155156 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-c1cb6f3c-cb29-406c-bb2b-ce63d3787573 req-bb9c0774-3f21-4126-b5c1-8dcc8703d39e service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:51.167071 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:51.177153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:51.182176 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:51.187325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-132474e3-db85-40f1-bb95-8cb300feba6f tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.356328 Nov 22 13:50:51.187921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 504/1021] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:50 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:51.188669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-c1cb6f3c-cb29-406c-bb2b-ce63d3787573 req-bb9c0774-3f21-4126-b5c1-8dcc8703d39e service nova] Creating event network-changed:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:50:51.194530 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-c1cb6f3c-cb29-406c-bb2b-ce63d3787573 req-bb9c0774-3f21-4126-b5c1-8dcc8703d39e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081893 Nov 22 13:50:51.195939 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 518/1022] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:50:52.206911 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:52.207495 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:52.214307 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:52.215475 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:52.216452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:52.216886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:52.425149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:52.433464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:52.434997 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:52.436104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e254ed1c-a313-460c-9a13-12a8c720bfa0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.234710 Nov 22 13:50:52.436664 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 505/1023] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:52 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:53.455189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:53.455883 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:53.462526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:53.462974 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:53.463746 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:53.464178 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:53.612350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:53.620985 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:53.623278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:53.624385 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-435a7581-43ae-497b-93f1-2a37c0b82bd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.173223 Nov 22 13:50:53.624944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 519/1024] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:53 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:54.641657 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:54.642271 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:54.648545 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:54.649002 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:54.649831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:54.650272 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:54.780619 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:54.788289 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:54.789799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:54.790895 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f14f12e4-8c2a-44ec-a83e-af62cd83d889 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.152911 Nov 22 13:50:54.791449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 506/1025] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:54 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:55.809958 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:55.810594 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:55.816900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:55.817383 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:55.818248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:55.818685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:55.952653 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:55.960238 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:55.961751 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:55.962833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b05f6422-aab5-40cb-a0e6-dca601cf36e9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.157543 Nov 22 13:50:55.963409 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 520/1026] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:55 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:56.979871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:56.980971 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:56.987321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:56.987769 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:56.988553 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:56.988988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:57.118968 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:57.132768 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:57.134300 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:57.135429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-176f6abe-aed4-4998-984a-2c1cf2961fd8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.159265 Nov 22 13:50:57.135988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 507/1027] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:56 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:58.154484 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:58.154996 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:58.161444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:58.161896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:58.162670 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:58.163100 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:58.299335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:58.307058 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:58.308553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:58.310508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-23315b3b-41b8-438e-b054-9e8293825ddf tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.159596 Nov 22 13:50:58.310934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 521/1028] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:58 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:59.328049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:50:59.328661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:50:59.335454 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:59.335908 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:59.336974 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:59.337455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:59.481461 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:59.491142 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:59.493156 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:50:59.494788 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5ab10d81-d14e-4307-b88c-13ce98246ab5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.170617 Nov 22 13:50:59.495330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 508/1029] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:50:59 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:50:59.734910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-28729ab3-d13b-4d58-9928-7e784f3cafb5 req-3b3f669d-4132-4ea8-aaa0-66c40051a051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "name": "network-vif-plugged", "status": "completed", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:50:59.736439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:50:59.736439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:50:59.744110 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-28729ab3-d13b-4d58-9928-7e784f3cafb5 req-3b3f669d-4132-4ea8-aaa0-66c40051a051 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:50:59.744541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-28729ab3-d13b-4d58-9928-7e784f3cafb5 req-3b3f669d-4132-4ea8-aaa0-66c40051a051 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:50:59.755972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-28729ab3-d13b-4d58-9928-7e784f3cafb5 req-3b3f669d-4132-4ea8-aaa0-66c40051a051 service nova] Creating event network-vif-plugged:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:50:59.760651 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-28729ab3-d13b-4d58-9928-7e784f3cafb5 req-3b3f669d-4132-4ea8-aaa0-66c40051a051 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030058 Nov 22 13:50:59.761502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 522/1030] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:51:00.515082 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:00.516387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:00.522584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:00.523130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:00.524007 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:00.524520 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:00.660503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:00.668231 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:00.669982 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:00.671081 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d86bb8f2-29dd-422a-9ffe-9870bbe7d44d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1405 microversion: 2.20 time: 0.161762 Nov 22 13:51:00.671643 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 509/1031] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:00 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:00.825879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1139474776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445698613", "security_groups": [{"name": "tempest-secgroup-smoke-451825004"}], "block_device_mapping_v2": [{"uuid": "7203cab2-782a-4d64-bb54-a465c47f4105", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1613968-954e-4fd7-ab36-ee6aeaa13142"}]}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:00.933595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.network.neutron [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] validate_networks() for [('d1613968-954e-4fd7-ab36-ee6aeaa13142', None, None, None, None, None)] {{(pid=122685) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 13:51:01.300246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 13:51:01.300709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image limits 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 13:51:01.301155 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Flavor pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 13:51:01.301618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Image pref 0:0:0 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 13:51:01.302035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.virt.hardware [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 13:51:01.310876 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.311325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:01.312153 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.312595 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:01.329260 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 13:51:01.333147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.quota [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Getting quotas for user 526b9ef5f3674c13b98a9ce5e30923f4 and project accea9af00354befabcdcf4325a007ca. Resources: {'ram', 'instances', 'cores'} {{(pid=122685) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 13:51:01.391535 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Going to run 1 instances... {{(pid=122685) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 13:51:01.393833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7203cab2-782a-4d64-bb54-a465c47f4105',volume_size=None,volume_type=None)] {{(pid=122685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 13:51:01.512263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d9bc1c48-2676-48a9-be47-f254cc459815 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691301 Nov 22 13:51:01.513503 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 523/1032] 10.222.0.31 () {60 vars in 1146 bytes} [Mon Nov 22 13:51:00 2021] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 13:51:01.524108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-34224e19-db9f-42a2-971f-8846aef8e488 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:01.524722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-34224e19-db9f-42a2-971f-8846aef8e488 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:01.578965 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-34224e19-db9f-42a2-971f-8846aef8e488 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:01.589344 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-34224e19-db9f-42a2-971f-8846aef8e488 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1095 microversion: 2.1 time: 0.069285 Nov 22 13:51:01.590044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 510/1033] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:01 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:01.690161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:01.690937 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:01.697523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.698083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:01.699209 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.699801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:01.846815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:01.856040 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:01.858539 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:01.859877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-17eb2cd7-3043-4947-a452-60a541557115 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1596 microversion: 2.20 time: 0.174005 Nov 22 13:51:01.872933 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 524/1034] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:01 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1596 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:01.879820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:01.880652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:01.899420 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.900316 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:01.905429 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:01.905936 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.013719 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-a0f92f32-db8c-47ac-80f2-872560518280 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.138798 Nov 22 13:51:02.014875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 511/1035] 10.222.0.31 () {60 vars in 1315 bytes} [Mon Nov 22 13:51:01 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:51:02.606285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:02.608000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:02.613908 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:02.614434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.615287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:02.615794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.675016 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:02.682472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6e6c0bae-4295-47d1-bdb6-72e54838e8b3 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1193 microversion: 2.1 time: 0.079890 Nov 22 13:51:02.683056 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 525/1036] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:02 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:02.965390 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:02.966988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:02.970343 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-43dfdfe9-3d88-48de-9441-6a4293200438 req-956217d9-d633-4e1b-962f-82a9cbc31a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:02.971839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:51:02.971839 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:51:02.979449 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-43dfdfe9-3d88-48de-9441-6a4293200438 req-956217d9-d633-4e1b-962f-82a9cbc31a41 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:02.979963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-43dfdfe9-3d88-48de-9441-6a4293200438 req-956217d9-d633-4e1b-962f-82a9cbc31a41 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.984843 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:02.985304 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.986115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:02.986557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:02.995239 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-43dfdfe9-3d88-48de-9441-6a4293200438 req-956217d9-d633-4e1b-962f-82a9cbc31a41 service nova] Creating event network-changed:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:51:03.000246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-43dfdfe9-3d88-48de-9441-6a4293200438 req-956217d9-d633-4e1b-962f-82a9cbc31a41 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Nov 22 13:51:03.001093 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 526/1037] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:51:03.700309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:03.700895 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:03.707284 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:03.707734 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:03.708546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:03.709095 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:03.772794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:03.782786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-18413470-4844-4406-95de-a99da274e2db tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1193 microversion: 2.1 time: 0.086527 Nov 22 13:51:03.783372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 527/1038] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:03 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:04.799977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:04.801341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:04.808319 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:04.808769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:04.809590 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:04.810026 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:04.868701 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:04.875942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5142a896-a738-4047-97d9-bf69d49552f9 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1193 microversion: 2.1 time: 0.079604 Nov 22 13:51:04.876505 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 528/1039] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:04 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:05.389979 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-38e2cff0-ee14-4a61-a89b-fdb3c564955d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 2.427914 Nov 22 13:51:05.393371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 512/1040] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:02 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 2432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:05.892388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:05.893134 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:05.900478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:05.900923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:05.901963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:05.902561 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:06.008923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:06.016689 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a944c5e9-5ba8-4ff2-9c59-599a0e0d2bca tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1211 microversion: 2.1 time: 0.128041 Nov 22 13:51:06.017278 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 529/1041] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:05 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:06.403669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:06.404845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:06.416596 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:06.419111 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:06.420254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:06.420745 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:06.511984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2412932e-8589-4776-81d7-dc2f731c0756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.114403 Nov 22 13:51:06.514804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 513/1042] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:06 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:06.919882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-f57ab5b7-7dd0-4c18-aae7-454520e6fcfd req-b3accb2e-ee82-43e8-a7c5-a6195dc05c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c96b11-877d-4f0a-8092-d54a9d9d1bb9", "tag": "46d2159e-1a72-4e7c-ac55-097dbb7f1756"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:06.922158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:51:06.922158 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:51:06.931736 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-f57ab5b7-7dd0-4c18-aae7-454520e6fcfd req-b3accb2e-ee82-43e8-a7c5-a6195dc05c62 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:06.932247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-f57ab5b7-7dd0-4c18-aae7-454520e6fcfd req-b3accb2e-ee82-43e8-a7c5-a6195dc05c62 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:06.954455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-f57ab5b7-7dd0-4c18-aae7-454520e6fcfd req-b3accb2e-ee82-43e8-a7c5-a6195dc05c62 service nova] Creating event network-changed:46d2159e-1a72-4e7c-ac55-097dbb7f1756 for instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 on hv-cinder-76845 Nov 22 13:51:06.959200 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-f57ab5b7-7dd0-4c18-aae7-454520e6fcfd req-b3accb2e-ee82-43e8-a7c5-a6195dc05c62 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043795 Nov 22 13:51:06.960014 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 530/1043] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:51:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:51:07.036020 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:07.036722 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:07.044599 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:07.045045 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:07.045865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:07.046296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:07.191284 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:07.198784 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80214c94-3eb0-4086-9c87-847cc0edaaba tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.166813 Nov 22 13:51:07.200058 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 514/1044] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:07 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:07.522847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:07.523868 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:07.530593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:07.531039 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:07.531813 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:07.532247 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:07.602357 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-06b8afb7-fb57-4a30-a78a-f490474b67f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.083477 Nov 22 13:51:07.604349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 531/1045] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:07 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:08.217820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:08.218440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:08.224725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:08.225226 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:08.226012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:08.226453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:08.358741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:08.365996 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-468746d2-5f73-471f-a68f-88a450ed1549 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.152738 Nov 22 13:51:08.366565 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 515/1046] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:08 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:08.613664 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:08.614593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:08.621361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:08.622363 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:08.623151 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:08.623618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:08.684913 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c98863a3-235e-41af-ac32-1348d12c4996 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.074677 Nov 22 13:51:08.685761 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 532/1047] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:08 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:09.383715 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:09.384330 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:09.391269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:09.391668 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:09.392447 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:09.392886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:09.527825 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:09.535165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c627456d-2be5-44bc-9d92-4b68f40cc9b5 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.155164 Nov 22 13:51:09.535723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 516/1048] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:09 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:09.696482 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:09.697419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:09.704126 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:09.704573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:09.705372 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:09.705807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:09.771967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-49e2365e-4883-4962-a423-cee9b236d6dc tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.079465 Nov 22 13:51:09.772542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 533/1049] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:09 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:10.552464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:10.553090 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:10.559485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:10.560155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:10.560943 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:10.561425 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:10.700692 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:10.707966 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1426e153-0410-4c1c-88d3-eefceae121c4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.159572 Nov 22 13:51:10.708508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 517/1050] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:10 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:10.783979 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:10.785064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:10.792271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:10.792720 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:10.793568 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:10.794059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:10.857592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8e43317c-db42-48bc-abc5-753b7e7fb45e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.077508 Nov 22 13:51:10.858177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 534/1051] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:10 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:11.725134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:11.725778 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:11.732661 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:11.733104 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:11.733913 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:11.734348 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:11.868309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:11.869321 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:11.873378 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:11.877485 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:11.877938 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:11.878724 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:11.879201 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:11.881786 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-093e9956-ff83-4276-aee0-d8c6904e6414 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.160332 Nov 22 13:51:11.882385 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 518/1052] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:11 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:11.949691 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2dc0d9f5-dc01-437a-8c59-127e5224dad2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.085138 Nov 22 13:51:11.950507 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 535/1053] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:11 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:12.900449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:12.901059 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:12.907755 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:12.908197 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:12.908971 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:12.909427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:12.960496 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:12.961521 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:12.968347 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:12.969325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:12.970161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:12.970597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:13.036646 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-be3b7256-d582-401b-8d5d-64f5262d12da tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.079933 Nov 22 13:51:13.037446 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 536/1054] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:12 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:13.048396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:13.055927 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d796157a-1944-4663-9138-0b65aa936cd1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.159408 Nov 22 13:51:13.056505 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 519/1055] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:12 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:14.047967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:14.048975 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:14.056177 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:14.056624 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:14.057440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:14.057878 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:14.073682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:14.074296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:14.080709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:14.081178 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:14.082108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:14.082441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:14.130794 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e404e372-7ee6-4be3-be9d-0cb6310f7a44 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 14 microversion: 2.20 time: 0.087192 Nov 22 13:51:14.131463 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 537/1056] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:14 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:14.220192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:14.227530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-94b60e13-4628-4f22-8c70-acf8cfa99f48 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.157739 Nov 22 13:51:14.228095 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 520/1057] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:14 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:15.142904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:15.143944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:15.150897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:15.151350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:15.152175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:15.152609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:15.233332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c5319ac6-5820-4eff-b11e-fbd90f4214ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 8392 microversion: 2.20 time: 0.094754 Nov 22 13:51:15.233978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 538/1058] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:15 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 8392 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:15.244713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:15.245421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:15.252560 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:15.253011 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:15.253838 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:15.254279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:15.391449 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:15.399279 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7987e331-7493-4fa2-8754-f4fbb13d4952 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.158041 Nov 22 13:51:15.399804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 521/1059] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:15 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:16.244001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:16.245002 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:16.252730 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:16.253251 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:16.254042 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:16.254481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:16.330697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-2096e036-f043-4ec0-b6b9-ca6e03d01ead tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 15025 microversion: 2.20 time: 0.090593 Nov 22 13:51:16.334255 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 539/1060] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:16 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:16.417024 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:16.417635 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:16.424107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:16.424554 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:16.425355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:16.425790 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:16.561804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:16.570006 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-60c0609c-c7d3-435f-ba84-9bf42cfe7aaf tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.157072 Nov 22 13:51:16.570671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 522/1061] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:16 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:17.342422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:17.343476 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:17.350916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:17.351508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:17.352401 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:17.352853 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:17.427019 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e3613ccd-ceea-483f-a5b7-0457885a30a6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 18083 microversion: 2.20 time: 0.088408 Nov 22 13:51:17.430235 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 540/1062] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:17 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 18083 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:17.589229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:17.589845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:17.596720 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:17.597105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:17.597905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:17.598341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:17.739521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:17.747530 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7461effd-06a0-4366-8ca0-791166398e19 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.162837 Nov 22 13:51:17.748461 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 523/1063] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:17 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:51:17.856788 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-59733500-847d-4963-8ce3-3ee301183636 req-e8da6abe-7da8-454b-955f-606ce1261919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c96b11-877d-4f0a-8092-d54a9d9d1bb9", "name": "network-vif-plugged", "status": "completed", "tag": "46d2159e-1a72-4e7c-ac55-097dbb7f1756"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:17.858407 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:51:17.858407 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:51:17.869240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-59733500-847d-4963-8ce3-3ee301183636 req-e8da6abe-7da8-454b-955f-606ce1261919 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:17.869415 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-59733500-847d-4963-8ce3-3ee301183636 req-e8da6abe-7da8-454b-955f-606ce1261919 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:17.880920 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-59733500-847d-4963-8ce3-3ee301183636 req-e8da6abe-7da8-454b-955f-606ce1261919 service nova] Creating event network-vif-plugged:46d2159e-1a72-4e7c-ac55-097dbb7f1756 for instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 on hv-cinder-76845 Nov 22 13:51:17.885635 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-59733500-847d-4963-8ce3-3ee301183636 req-e8da6abe-7da8-454b-955f-606ce1261919 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Nov 22 13:51:17.886549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 541/1064] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:51:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:51:18.439044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:18.439862 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:18.445716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:18.446164 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:18.446938 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:18.447370 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:18.533677 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7e3baac4-fa02-4877-b07e-49f131132d0e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 18915 microversion: 2.20 time: 0.098730 Nov 22 13:51:18.534346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 524/1065] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:18 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 18915 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:18.765309 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:18.766018 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:18.772440 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:18.772893 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:18.773734 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:18.774173 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:18.911325 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:18.918702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-716cb39c-5a14-4b6c-868a-8a2414f8594a tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1266 microversion: 2.1 time: 0.157392 Nov 22 13:51:18.919271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 542/1066] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:18 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:19.547157 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:19.548935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:19.555804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:19.556252 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:19.557034 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:19.557486 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:19.646921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-61ca6bfe-7ee3-439a-8478-1189135cf76c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 20593 microversion: 2.20 time: 0.104854 Nov 22 13:51:19.647603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 525/1067] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:19 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 20593 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:19.935359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:19.935942 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:19.943465 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:19.943856 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:19.944636 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:19.945073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:20.079134 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:20.086384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-97279723-5a31-44c9-b1f7-18f4bf35ca50 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1454 microversion: 2.1 time: 0.154662 Nov 22 13:51:20.086946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 543/1068] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:19 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:20.103105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:20.103804 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:20.111338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:20.111875 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:20.112665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:20.113107 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:20.247144 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:20.256229 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-03aa3ea4-0ffc-4799-aa57-9f7ce10c6359 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1454 microversion: 2.1 time: 0.157110 Nov 22 13:51:20.256805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 526/1069] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:51:20 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:51:20.658728 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:20.659740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:20.666161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:20.666609 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:20.667392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:20.667828 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:20.745377 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-044e1fa6-f4ce-47f4-b261-a194b60cc50b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 22488 microversion: 2.20 time: 0.090196 Nov 22 13:51:20.745944 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 544/1070] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:20 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 22488 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:51:21.757894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:21.758827 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:21.765118 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:21.765584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:21.766362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:21.766856 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:21.843660 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fe468837-a01b-48c2-b0da-7525cf7a5f37 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 23557 microversion: 2.20 time: 0.089371 Nov 22 13:51:21.844346 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 527/1071] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:21 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 23557 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:22.353857 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-5f315565-e169-4dc9-a8e6-3c1d3fc50d23 req-bfa2169e-b310-4009-b1a8-6bf594c9d1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c96b11-877d-4f0a-8092-d54a9d9d1bb9", "tag": "46d2159e-1a72-4e7c-ac55-097dbb7f1756"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:22.355305 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:51:22.355305 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:51:22.364053 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f315565-e169-4dc9-a8e6-3c1d3fc50d23 req-bfa2169e-b310-4009-b1a8-6bf594c9d1a0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:22.364497 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-5f315565-e169-4dc9-a8e6-3c1d3fc50d23 req-bfa2169e-b310-4009-b1a8-6bf594c9d1a0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:22.375718 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-5f315565-e169-4dc9-a8e6-3c1d3fc50d23 req-bfa2169e-b310-4009-b1a8-6bf594c9d1a0 service nova] Creating event network-changed:46d2159e-1a72-4e7c-ac55-097dbb7f1756 for instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 on hv-cinder-76845 Nov 22 13:51:22.380800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-5f315565-e169-4dc9-a8e6-3c1d3fc50d23 req-bfa2169e-b310-4009-b1a8-6bf594c9d1a0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030830 Nov 22 13:51:22.381475 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 545/1072] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:51:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:51:22.857905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:22.859158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:22.868366 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:22.868919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:22.869828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:22.870341 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:22.955023 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cc65f21a-0df6-4369-8315-115eb77c1041 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 24594 microversion: 2.20 time: 0.101050 Nov 22 13:51:22.955828 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 528/1073] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:22 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 24594 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:23.967904 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:23.968900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:23.975847 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:23.976243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:23.977029 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:23.977495 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:24.069414 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fd594b50-9318-4627-bdef-bb1ba3dfdbca tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 25872 microversion: 2.20 time: 0.105857 Nov 22 13:51:24.070064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 546/1074] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:23 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 25872 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:25.080301 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:25.081364 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:25.088247 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:25.088702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:25.089590 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:25.090032 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:25.182813 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-cf690032-88ec-40e8-99bd-49836fbdf0fb tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 26882 microversion: 2.20 time: 0.106313 Nov 22 13:51:25.183369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 529/1075] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:25 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 26882 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:26.195708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:26.196725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:26.203541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:26.204154 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:26.204981 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:26.205448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:26.289701 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-24fa2c80-ddc0-4eb9-b203-b280ed6763f4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 27618 microversion: 2.20 time: 0.097919 Nov 22 13:51:26.290330 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 547/1076] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:26 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 27618 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:27.302387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:27.303402 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:27.310479 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:27.310999 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:27.311713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:27.312155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:27.393812 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-35800609-2c8d-4918-9739-0b0c08dd04ab tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28039 microversion: 2.20 time: 0.096227 Nov 22 13:51:27.397802 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 530/1077] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:27 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28039 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:28.406089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:28.407152 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:28.414124 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:28.414566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:28.415349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:28.415798 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:28.494801 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-0e179f30-810b-467b-af21-4d8844518626 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28166 microversion: 2.20 time: 0.092734 Nov 22 13:51:28.495439 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 548/1078] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:28 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28166 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:29.507127 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:29.508153 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:29.515040 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:29.515488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:29.516275 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:29.516727 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:29.580476 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8495116f-5829-475b-a347-b6d2b9ade8ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28166 microversion: 2.20 time: 0.077203 Nov 22 13:51:29.581130 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 531/1079] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:29 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28166 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:30.592434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:30.593463 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:30.600926 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:30.601399 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:30.602183 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:30.602650 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:30.678108 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-707a7415-7a88-4a83-8d5d-cc18c7e98ad9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28457 microversion: 2.20 time: 0.089607 Nov 22 13:51:30.678739 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 549/1080] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:30 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28457 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:31.690601 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:31.691610 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:31.698567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:31.699019 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:31.699806 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:31.700248 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:31.778221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-5b3b9be4-a35b-4af7-a1c9-730278ef5e56 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28625 microversion: 2.20 time: 0.091757 Nov 22 13:51:31.778893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 532/1081] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:31 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:32.789332 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:32.790338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:32.797288 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:32.797842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:32.799369 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:32.799995 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:32.868780 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-124ffabb-22da-4b13-83ae-074372319917 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28625 microversion: 2.20 time: 0.083369 Nov 22 13:51:32.869674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 550/1082] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:32 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28625 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:33.881874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:33.882874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:33.889647 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:33.890092 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:33.890863 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:33.891294 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:33.959861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1fe98d7d-9a5a-4940-a84d-9f409ab05d23 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28625 microversion: 2.20 time: 0.082841 Nov 22 13:51:33.960488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 533/1083] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:33 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28625 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:34.972546 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:34.973577 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:34.980472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:34.980923 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:34.981745 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:34.982184 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:37.860638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8390d408-e8a8-4be7-9fc4-bfffd4ae8eed tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 28625 microversion: 2.20 time: 2.891942 Nov 22 13:51:37.861699 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 551/1084] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:34 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 28625 bytes in 2894 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:38.873125 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:38.875584 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:38.881989 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:38.882645 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:38.883441 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:38.883879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:38.969431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-effa5aee-480c-4838-bed5-e366fad84164 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 29980 microversion: 2.20 time: 0.100037 Nov 22 13:51:38.970697 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 534/1085] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:38 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 29980 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:51:39.982865 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:39.983874 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:39.991159 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:39.991613 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:39.992397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:39.992830 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:42.236916 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e12f1601-a873-430b-935a-a60a3d142296 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 33537 microversion: 2.20 time: 2.257984 Nov 22 13:51:42.238083 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 552/1086] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:39 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 33537 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:43.249365 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:43.250460 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:43.263850 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:43.264297 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:43.265080 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:43.265538 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:43.340334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6f5e8f8c-85e6-493e-8fe3-757d7fdfb3f6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 34462 microversion: 2.20 time: 0.095683 Nov 22 13:51:43.341238 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 535/1087] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:43 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 34462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:44.352560 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:44.353603 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:44.361131 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:44.361618 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:44.362408 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:44.362851 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:46.309725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-792d4b64-183c-4469-a9d3-ea08f32394ea tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 38057 microversion: 2.20 time: 1.960926 Nov 22 13:51:46.310454 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 553/1088] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:44 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 38057 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 13:51:47.322648 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:47.323669 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:47.330665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:47.331325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:47.332154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:47.332581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:47.415052 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-03e2e0c0-c09c-4651-9ae7-634e33ad4b53 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 38165 microversion: 2.20 time: 0.096308 Nov 22 13:51:47.415741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 536/1089] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:47 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 38165 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:48.428172 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:48.429088 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:48.436786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:48.437259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:48.438048 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:48.438490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:48.509946 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f0dd1a8e-d8a2-4c3e-b682-05be688a3bf4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 38165 microversion: 2.20 time: 0.086042 Nov 22 13:51:48.510842 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 554/1090] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:48 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 38165 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:49.524062 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:49.525129 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:49.532351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:49.532805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:49.534350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:49.534890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:49.600874 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f7097c84-7d54-4a52-9e3b-d584752c1959 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 38165 microversion: 2.20 time: 0.082460 Nov 22 13:51:49.605101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 537/1091] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:49 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 38165 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:50.612282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:50.614076 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:50.621059 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:50.621553 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:50.622373 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:50.622812 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:50.710827 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-37f51cae-57af-484b-8332-3ac09d801aa3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 200 len: 38304 microversion: 2.20 time: 0.102436 Nov 22 13:51:50.711767 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 555/1092] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:50 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 38304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:51:50.721937 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:50.722877 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:50.729481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:50.729935 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:50.730714 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:50.731154 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:50.755115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-50232699-b975-456c-aab9-eb623182fbae tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/ips" status: 200 len: 150 microversion: 2.20 time: 0.037510 Nov 22 13:51:50.755674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 538/1093] 10.222.0.31 () {60 vars in 1288 bytes} [Mon Nov 22 13:51:50 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 13:51:52.833592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:51:52.834243 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:52.841301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:52.841844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:52.842705 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:52.843214 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:52.867874 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lazy-loading 'flavor' on Instance uuid f8fb652e-5293-4626-abe6-4731dc711ce3 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:51:53.141836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-3b27a494-e011-42c5-ba4a-25df2a0a8862 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 202 len: 0 microversion: 2.20 time: 0.313224 Nov 22 13:51:53.145597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 556/1094] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:51:52 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:51:53.152273 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:53.152879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:53.160557 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:53.161080 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:53.162093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:53.162637 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:53.314151 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:53.322757 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:53.324224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:53.325395 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-fda51e58-eccb-4f7c-9535-598c0cc5eb8a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.178128 Nov 22 13:51:53.325969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 539/1095] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:53 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:54.344410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:54.345098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:54.351901 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:54.352350 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:54.353215 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:54.353652 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:54.484196 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:54.492392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:54.493924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:54.495067 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cc9ff272-afa4-44de-9eda-1b76436a1019 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.155174 Nov 22 13:51:54.495622 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 557/1096] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:54 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:55.514084 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:55.514693 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:55.521738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:55.522192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:55.522973 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:55.523410 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:55.652412 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:55.660163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:55.661662 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:55.662797 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e9f7c33f-98b9-4f11-8fa0-eceb94c719c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.152451 Nov 22 13:51:55.663351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 540/1097] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:55 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:56.680663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:56.681293 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:56.687759 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:56.688203 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:56.688977 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:56.689444 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:56.817882 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:56.825448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:56.826928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:56.828068 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-d7f90bff-26c8-4b51-877b-5e0e981ed9b6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.151071 Nov 22 13:51:56.828627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 558/1098] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:56 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:57.847018 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:57.847634 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:57.854183 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:57.854634 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:57.855421 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:57.855860 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:57.990159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:57.997861 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:57.999328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:58.000469 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-e4e7d42f-972a-44d7-afa8-c900c2352dd9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.158272 Nov 22 13:51:58.001029 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 541/1099] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:57 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:51:59.020078 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:51:59.020695 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:51:59.027020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:59.027481 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:59.028269 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:51:59.028712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:51:59.160348 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:59.168020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:59.169541 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:51:59.170694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-868b3b4d-d049-4ccf-bb27-3d81f3fe0e16 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.155146 Nov 22 13:51:59.171257 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 559/1100] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:51:59 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:00.189133 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:00.189869 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:00.196128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:00.196572 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:00.197387 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:00.197818 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:00.326894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:00.335125 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:00.336598 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:00.337777 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-75fa1377-d539-4e0b-8bec-62fba986439a tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.152337 Nov 22 13:52:00.338334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 542/1101] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:00 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:01.356388 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:01.356927 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:01.363864 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:01.364313 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:01.365086 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:01.365550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:01.493836 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:01.501422 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:01.503637 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:01.504786 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-8291d9e5-33ed-40e7-90db-f6e6c8d29299 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.152192 Nov 22 13:52:01.505450 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 560/1102] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:01 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:02.523432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:02.524075 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:02.530270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:02.530716 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:02.531495 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:02.531932 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:02.660513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:02.668262 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:02.669763 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:02.670910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f22b41ee-0ac0-431d-8709-e7e2af9405d5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.151189 Nov 22 13:52:02.671471 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 543/1103] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:02 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:03.228327 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:03.228860 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:03.235707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.236960 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.237239 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-89db2c3e-1da0-40dc-ba92-23211c28376c req-8f7a366f-75b2-4078-8151-40c0b00d50b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:03.238230 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.238750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:52:03.238750 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:52:03.239049 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.248282 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-89db2c3e-1da0-40dc-ba92-23211c28376c req-8f7a366f-75b2-4078-8151-40c0b00d50b8 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.248723 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-89db2c3e-1da0-40dc-ba92-23211c28376c req-8f7a366f-75b2-4078-8151-40c0b00d50b8 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.261375 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-89db2c3e-1da0-40dc-ba92-23211c28376c req-8f7a366f-75b2-4078-8151-40c0b00d50b8 service nova] Creating event network-changed:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:52:03.267143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:52:03.268065 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-89db2c3e-1da0-40dc-ba92-23211c28376c req-8f7a366f-75b2-4078-8151-40c0b00d50b8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033787 Nov 22 13:52:03.268994 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 544/1104] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:52:03.351297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-98467879-3b6f-4acc-9fcb-51821316fdec tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "DELETE /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 204 len: 0 microversion: 2.1 time: 0.126229 Nov 22 13:52:03.355423 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 561/1105] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:52:03 2021] DELETE /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:52:03.361659 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:03.362434 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:03.370355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.370355 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.371227 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.371658 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.522254 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:03.530975 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c816372f-1c12-4195-99c1-373a8579f100 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1567 microversion: 2.1 time: 0.174026 Nov 22 13:52:03.531586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 545/1106] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:52:03 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:52:03.692525 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:03.693707 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:03.700550 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.701020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.701854 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:03.702300 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:03.903441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:03.911789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:03.913301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:03.914461 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c24d8def-db3f-42f7-8fa6-a7971e463ce5 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.228872 Nov 22 13:52:03.915020 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 562/1107] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:03 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:04.548262 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:04.548803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:04.555270 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:04.555718 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:04.556513 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:04.556924 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:04.688819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:04.696310 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c649e6cf-2dce-485a-800b-4b45268bfbf4 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1449 microversion: 2.1 time: 0.151772 Nov 22 13:52:04.696871 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 546/1108] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:52:04 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:52:04.932432 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:04.933042 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:04.939965 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:04.940419 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:04.941217 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:04.941675 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:05.213487 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:05.221692 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:05.223163 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:05.224297 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e04e6343-7842-4100-8075-ab83d03854f1 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1741 microversion: 2.20 time: 0.295564 Nov 22 13:52:05.224845 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 563/1109] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:04 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:05.713499 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:05.714358 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:05.721725 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:05.722269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:05.723179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:05.723649 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:05.808872 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:05.817630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2fd49571-3d0b-490e-8dc2-f5aa25982207 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1382 microversion: 2.1 time: 0.107638 Nov 22 13:52:05.818357 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 547/1110] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:52:05 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1382 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:52:05.820451 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-6a6ae689-27a2-4bad-89c0-5dd4882cdca1 req-111b4a22-6296-4881-9c4c-206efab8de97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928c471e-c956-4529-9003-2d16d7499657", "name": "network-vif-deleted", "tag": "e14d8dd0-493d-48ab-9595-8fbb34bdb29d"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:05.822896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:52:05.822896 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:52:05.832988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6a6ae689-27a2-4bad-89c0-5dd4882cdca1 req-111b4a22-6296-4881-9c4c-206efab8de97 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:05.834806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-6a6ae689-27a2-4bad-89c0-5dd4882cdca1 req-111b4a22-6296-4881-9c4c-206efab8de97 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:05.849064 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-6a6ae689-27a2-4bad-89c0-5dd4882cdca1 req-111b4a22-6296-4881-9c4c-206efab8de97 service nova] Creating event network-vif-deleted:e14d8dd0-493d-48ab-9595-8fbb34bdb29d for instance 928c471e-c956-4529-9003-2d16d7499657 on hv-cinder-76845 Nov 22 13:52:05.854354 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-6a6ae689-27a2-4bad-89c0-5dd4882cdca1 req-111b4a22-6296-4881-9c4c-206efab8de97 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 Nov 22 13:52:05.855227 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 564/1111] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:52:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:52:06.242351 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:06.243682 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:06.254702 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:06.255158 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:06.255964 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:06.256402 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:06.504820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:06.517676 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:06.520128 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:06.521521 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8cf32488-d919-453d-aa37-bbcceef4e647 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.282877 Nov 22 13:52:06.524163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 548/1112] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:06 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:06.837146 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:06.837874 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:06.854394 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:06.854886 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:06.856627 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:06.857324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:06.895978 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:06.896617 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:06.897384 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.objects.instance [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lazy-loading 'fault' on Instance uuid 928c471e-c956-4529-9003-2d16d7499657 {{(pid=122685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 13:52:06.949763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abbc6b58dd44094a88ab8d4b4587935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a9603fada4f72a111322a25c91454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:06.959815 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-14efeeb6-096f-4d68-b33d-9000c5a208ad tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 200 len: 1224 microversion: 2.1 time: 0.127454 Nov 22 13:52:06.960763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 565/1113] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:52:06 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:52:07.543450 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:07.544406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:07.553665 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:07.554940 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:07.555992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:07.556515 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:07.711606 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:07.723286 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:07.725103 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:07.726409 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-80ba7acf-246c-4558-98dc-580f0d9afdef tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.186630 Nov 22 13:52:07.727077 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 549/1114] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:07 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:07.981028 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:07.981672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] [instance: 928c471e-c956-4529-9003-2d16d7499657] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:07.988143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:07.988593 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:07.989410 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:07.990027 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:08.009897 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] HTTP exception thrown: Instance 928c471e-c956-4529-9003-2d16d7499657 could not be found. Nov 22 13:52:08.011287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Returning 404 to user: Instance 928c471e-c956-4529-9003-2d16d7499657 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:52:08.012125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e16d4ac5-7c65-4506-b775-b42678f85f21 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657" status: 404 len: 111 microversion: 2.1 time: 0.038727 Nov 22 13:52:08.012676 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 566/1115] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:52:07 2021] GET /compute/v2.1/servers/928c471e-c956-4529-9003-2d16d7499657 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:52:08.152773 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-d821d9ec-3ab1-49d5-a85e-6d291bc2351a req-6a2b9611-459a-4c2b-a6cf-7b851bb419f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "name": "network-vif-plugged", "status": "completed", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:08.154674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:52:08.154674 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:52:08.170402 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-d821d9ec-3ab1-49d5-a85e-6d291bc2351a req-6a2b9611-459a-4c2b-a6cf-7b851bb419f8 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:08.172608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-d821d9ec-3ab1-49d5-a85e-6d291bc2351a req-6a2b9611-459a-4c2b-a6cf-7b851bb419f8 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:08.192832 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-d821d9ec-3ab1-49d5-a85e-6d291bc2351a req-6a2b9611-459a-4c2b-a6cf-7b851bb419f8 service nova] Creating event network-vif-plugged:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:52:08.200174 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-d821d9ec-3ab1-49d5-a85e-6d291bc2351a req-6a2b9611-459a-4c2b-a6cf-7b851bb419f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051984 Nov 22 13:52:08.203369 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 550/1116] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:52:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:52:08.224597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-cb7247b7-8ded-4750-b8bf-3e2bcccc7ec0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] Calling method '.version_select at 0x7f673daf7ca0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:08.272798 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-cb7247b7-8ded-4750-b8bf-3e2bcccc7ec0 tempest-TestShelveInstance-370045666 tempest-TestShelveInstance-370045666-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-717166159" status: 202 len: 0 microversion: 2.1 time: 0.054100 Nov 22 13:52:08.273452 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 567/1117] 10.222.0.31 () {58 vars in 1250 bytes} [Mon Nov 22 13:52:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-717166159 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:52:08.746991 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:08.750439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:08.760256 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:08.760717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:08.761543 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:08.762159 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:08.925365 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:08.934221 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:08.936126 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:08.937473 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b02fb32d-5d4f-49f4-8b85-e99403704a9e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.196161 Nov 22 13:52:08.938120 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 551/1118] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:08 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:09.959038 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:09.959731 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:09.966921 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:09.967891 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:09.968910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:09.969604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:10.344549 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:10.355600 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:10.357989 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:10.360259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-108558c2-bda6-4f20-bd85-2b4e244727f2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.405909 Nov 22 13:52:10.378567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 568/1119] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:09 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:11.382847 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:11.384132 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:11.391108 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:11.391814 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:11.393331 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:11.394435 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:11.643398 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:11.652698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:11.654497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:11.659562 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dd486f17-f651-44ac-b2e5-fdfd84e6b378 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.280312 Nov 22 13:52:11.661349 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 552/1120] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:11 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:12.679566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:12.680889 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:12.687930 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:12.688661 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:12.689790 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:12.690460 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:12.849176 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:12.857380 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:12.864621 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:12.866188 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-09444f6e-b69c-4775-9f03-3c9920b0d4e8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.190923 Nov 22 13:52:12.877392 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 569/1121] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:12 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:13.883919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:13.884446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:13.891359 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:13.892105 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:13.893073 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:13.893701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:14.128402 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:14.136696 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:14.141497 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:14.143489 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-21ba5be0-3afe-418e-aa00-f6fb8427fa95 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.263287 Nov 22 13:52:14.154959 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 553/1122] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:13 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:15.162807 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:15.163511 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:15.170232 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:15.171001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:15.172050 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:15.172732 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:15.339928 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:15.348563 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:15.350189 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:15.351522 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5b468a9f-d440-4513-9294-8730b3cf9f1d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.192388 Nov 22 13:52:15.352523 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 570/1123] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:15 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:16.372709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:16.373514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:16.380783 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:16.381110 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:16.382076 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:16.382427 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:16.569519 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:16.581236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:16.581236 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:16.581581 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3156b779-8f45-41ac-af6b-82f5c48827c0 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1736 microversion: 2.20 time: 0.214672 Nov 22 13:52:16.582845 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 554/1124] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:16 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:17.599877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:17.600477 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:17.606870 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:17.607317 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:17.608098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:17.608538 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:17.740635 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:17.748256 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:17.749811 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:17.751467 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c29283a3-782d-4346-8fb5-e4cb01ecb04c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1718 microversion: 2.20 time: 0.154848 Nov 22 13:52:17.752576 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 571/1125] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:17 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:18.770789 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:18.771452 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:18.777824 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:18.778275 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:18.779048 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:18.779483 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:18.909728 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:18.917414 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:18.918893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:18.920066 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-78f9cd4e-30d3-49c7-9b8f-9c3bb856a2ee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1718 microversion: 2.20 time: 0.153568 Nov 22 13:52:18.920631 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 555/1126] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:18 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:19.938282 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:19.938988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:19.945097 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:19.945573 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:19.946339 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:19.946769 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.089061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:20.095613 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-0a86ba1a-9915-439e-88f2-99f67b8ff432 req-30c83a14-ce06-4336-9929-9fa0e933dff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "name": "network-vif-unplugged", "status": "completed", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:20.097604 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:20.097831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:52:20.097831 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:52:20.099623 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:20.100800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e75bb294-b91b-4fef-9917-5db003e1077b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1661 microversion: 2.20 time: 0.166342 Nov 22 13:52:20.101379 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 572/1127] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:19 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1661 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:20.107065 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-0a86ba1a-9915-439e-88f2-99f67b8ff432 req-30c83a14-ce06-4336-9929-9fa0e933dff4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.107507 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-0a86ba1a-9915-439e-88f2-99f67b8ff432 req-30c83a14-ce06-4336-9929-9fa0e933dff4 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.119909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef3603d-1993-4d14-9145-1caef7eb878a"}} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:20.120958 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.compute.server_external_events [req-0a86ba1a-9915-439e-88f2-99f67b8ff432 req-30c83a14-ce06-4336-9929-9fa0e933dff4 service nova] Unable to find a host for instance f8fb652e-5293-4626-abe6-4731dc711ce3. Dropping event network-vif-unplugged {{(pid=122684) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 22 13:52:20.121103 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:20.121865 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-0a86ba1a-9915-439e-88f2-99f67b8ff432 req-30c83a14-ce06-4336-9929-9fa0e933dff4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030744 Nov 22 13:52:20.122446 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 556/1128] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 22 13:52:20.128001 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.128455 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.129339 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.129789 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.391179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f9524b6e-c04c-421b-9ab1-c14daa46484b tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275001 Nov 22 13:52:20.392333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 573/1129] 10.222.0.31 () {62 vars in 1363 bytes} [Mon Nov 22 13:52:20 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments => generated 188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 13:52:20.496905 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:20.497432 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:20.504321 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.504775 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.505575 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.506012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.719328 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-6c90b750-cc5d-446a-af0d-8d84e394e4b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments/9ef3603d-1993-4d14-9145-1caef7eb878a" status: 202 len: 0 microversion: 2.20 time: 0.226023 Nov 22 13:52:20.719941 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 557/1130] 10.222.0.31 () {60 vars in 1456 bytes} [Mon Nov 22 13:52:20 2021] DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments/9ef3603d-1993-4d14-9145-1caef7eb878a => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:52:20.772755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:20.773354 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:20.779651 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.780098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.780871 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.781340 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.853041 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5c57ab0d-d5e7-4673-bf31-4751afbb1182 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action" status: 202 len: 0 microversion: 2.20 time: 0.084009 Nov 22 13:52:20.853674 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 574/1131] 10.222.0.31 () {62 vars in 1318 bytes} [Mon Nov 22 13:52:20 2021] POST /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:52:20.862163 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:20.862770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:20.868428 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.868868 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:20.869671 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:20.870102 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:21.034371 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:21.042350 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:21.043848 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:21.045012 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-215aaa78-48bd-4f19-8c6e-bc860a44e816 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1669 microversion: 2.20 time: 0.187021 Nov 22 13:52:21.045605 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 558/1132] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:20 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:22.064833 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:22.065582 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:22.074934 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:22.075469 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:22.076335 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:22.076778 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:22.295263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:22.303517 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:22.305013 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:22.306178 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e7fc84c1-77e2-4f2f-8125-5d1ca3544ac3 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.246143 Nov 22 13:52:22.306735 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 575/1133] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:22 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:23.325580 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:23.326206 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:23.333224 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:23.333701 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:23.334652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:23.335155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:23.471758 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:23.479972 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:23.481551 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:23.482942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7ea0e3f0-b371-40ec-b416-b4d53bb39ec9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.160919 Nov 22 13:52:23.483745 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 559/1134] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:23 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:24.501045 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:24.502277 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:24.508694 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:24.509145 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:24.509962 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:24.510397 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:24.655559 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:24.664212 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:24.665725 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:24.666879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-bdc4b24d-8a85-4760-9b25-27c4c1f3a84e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.169558 Nov 22 13:52:24.667683 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 576/1135] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:24 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:25.684839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:25.685472 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:25.692068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:25.692508 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:25.693551 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:25.693990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:25.828603 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:25.837297 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:25.838727 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:25.839890 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-8a297104-3b68-4a62-991f-f9e0bfbc7956 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.158751 Nov 22 13:52:25.840453 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 560/1136] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:25 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:26.859703 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:26.860250 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:26.866669 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:26.867125 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:26.867910 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:26.868352 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:27.011134 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:27.019585 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:27.021105 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:27.022303 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-65838dd2-d8f5-4b16-8037-85ea2211e6a8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.166386 Nov 22 13:52:27.029690 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 577/1137] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:26 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:28.041437 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:28.042115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:28.048314 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:28.048771 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:28.049589 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:28.050880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:28.189296 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:28.198693 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:28.200586 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:28.201839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-aac146a5-cd73-4118-ad58-f65a48514941 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.164159 Nov 22 13:52:28.202496 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 561/1138] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:28 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:29.221039 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:29.223534 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:29.229744 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:29.230285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:29.231147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:29.231693 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:29.365872 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:29.374287 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:29.375764 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:29.377345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-669a6875-01c4-4b1c-8b8b-6d1d867cdca6 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.160197 Nov 22 13:52:29.383225 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 578/1139] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:29 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:30.396461 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:30.397089 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:30.403567 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:30.404015 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:30.404823 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:30.405289 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:30.802353 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:30.810488 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:30.812004 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:30.813172 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7affec96-97fe-4ca4-b501-cbe40210cb87 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.421198 Nov 22 13:52:30.823919 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 562/1140] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:30 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:31.831174 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:31.831832 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:31.838285 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:31.838677 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:31.839490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:31.839925 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:31.976478 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:31.984326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:31.985824 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:31.986956 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-5d6500ca-25d9-457e-9f3d-c5c71cee1000 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.159598 Nov 22 13:52:31.987589 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 579/1141] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:31 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:33.009062 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:33.009910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:33.016192 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:33.016644 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:33.017455 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:33.017894 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:33.151278 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:33.159431 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:33.160928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:33.162149 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3ee50421-1048-45dc-a28b-ed0fa8f5950d tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.156790 Nov 22 13:52:33.162717 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 563/1142] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:33 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:34.180597 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:34.181228 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:34.187351 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:34.187877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:34.188900 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:34.189502 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:34.331390 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:34.339031 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:34.340509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:34.341678 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-08697528-e95f-4b3a-b62f-14a85536969e tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.164807 Nov 22 13:52:34.342259 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 580/1143] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:34 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:35.360368 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:35.360963 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:35.367961 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:35.368405 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:35.369172 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:35.369623 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:35.497283 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:35.505101 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:35.506617 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:35.507752 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-63e2b144-f92e-441f-a789-8d1cc561a756 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.151125 Nov 22 13:52:35.508308 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 564/1144] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:35 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:36.526073 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:36.526704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:36.532899 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:36.533382 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:36.534793 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:36.535240 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:36.663361 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:36.670972 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:36.672441 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:36.673600 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-ccdb247d-3869-42d5-b24f-294c71befe3c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.151165 Nov 22 13:52:36.674143 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 581/1145] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:36 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:37.691381 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:37.691992 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:37.698348 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:37.698803 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:37.699642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:37.700080 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:37.848960 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:37.857799 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:37.860203 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:37.862473 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bc177b6f-d2fa-435d-8ecd-0ae653c3cca9 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.175095 Nov 22 13:52:37.865746 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 565/1146] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:37 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:38.882114 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:38.882724 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:38.888918 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:38.889407 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:38.890179 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:38.890607 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:39.022130 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:39.029785 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:39.031262 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:39.032435 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6260ac1a-8376-418a-95b2-fdcb5efed408 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.154068 Nov 22 13:52:39.032981 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 582/1147] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:38 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:40.051901 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:40.052531 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:40.059514 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:40.059976 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:40.060893 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:40.061364 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:40.199738 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:40.209139 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:40.210846 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:40.211851 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-37f05a49-47fc-4b89-936c-c0a59d46d3d2 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.164464 Nov 22 13:52:40.212417 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 566/1148] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:40 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:40.257987 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-1b05b60b-dd2d-40ec-ad46-d293d15d6865 req-68cc9c76-eb39-4cb0-937b-c23b266f720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "name": "network-vif-plugged", "status": "completed", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:52:40.259543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:52:40.259543 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:52:40.266994 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-1b05b60b-dd2d-40ec-ad46-d293d15d6865 req-68cc9c76-eb39-4cb0-937b-c23b266f720b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:40.267445 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-1b05b60b-dd2d-40ec-ad46-d293d15d6865 req-68cc9c76-eb39-4cb0-937b-c23b266f720b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:40.279630 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-1b05b60b-dd2d-40ec-ad46-d293d15d6865 req-68cc9c76-eb39-4cb0-937b-c23b266f720b service nova] Creating event network-vif-plugged:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:52:40.287529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-1b05b60b-dd2d-40ec-ad46-d293d15d6865 req-68cc9c76-eb39-4cb0-937b-c23b266f720b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Nov 22 13:52:40.287529 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 583/1149] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:52:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:52:41.230982 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:41.231604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:41.237923 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:41.238377 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:41.239165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:41.239604 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:41.372955 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:41.381462 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:41.382952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:41.384115 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-da22ac01-5122-4a44-86da-1bbaca978357 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1727 microversion: 2.20 time: 0.156873 Nov 22 13:52:41.384678 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 567/1150] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:41 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:52:42.403121 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:52:42.403741 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:52:42.411061 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:42.411508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:42.412333 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:52:42.412762 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:52:42.542663 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:42.550544 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:42.552035 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:52:42.553191 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-06c29945-ffc9-4a7e-ae56-2318b3cd16b8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1714 microversion: 2.20 time: 0.154240 Nov 22 13:52:42.553774 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 584/1151] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:52:42 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:53:06.550819 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:06.551367 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:06.557955 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-7e4cdd9c-0848-464e-b4b0-2690bc868335 req-3c644606-487e-47cb-8c46-3476ab92b67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c96b11-877d-4f0a-8092-d54a9d9d1bb9", "tag": "46d2159e-1a72-4e7c-ac55-097dbb7f1756"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:53:06.559434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:53:06.559434 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:53:06.565949 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:06.566506 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:06.567407 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:06.567659 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7e4cdd9c-0848-464e-b4b0-2690bc868335 req-3c644606-487e-47cb-8c46-3476ab92b67b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:06.567990 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:06.568106 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-7e4cdd9c-0848-464e-b4b0-2690bc868335 req-3c644606-487e-47cb-8c46-3476ab92b67b service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:06.579117 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-7e4cdd9c-0848-464e-b4b0-2690bc868335 req-3c644606-487e-47cb-8c46-3476ab92b67b service nova] Creating event network-changed:46d2159e-1a72-4e7c-ac55-097dbb7f1756 for instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 on hv-cinder-76845 Nov 22 13:53:06.585100 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-7e4cdd9c-0848-464e-b4b0-2690bc868335 req-3c644606-487e-47cb-8c46-3476ab92b67b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030612 Nov 22 13:53:06.586246 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 585/1152] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:06.597770 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:53:06.683481 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-ef5c7360-59f0-47f2-b5fe-ed899c31d466 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 204 len: 0 microversion: 2.1 time: 0.136374 Nov 22 13:53:06.684518 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 568/1153] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:53:06 2021] DELETE /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:53:06.695135 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:06.695877 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:06.702491 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:06.703272 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:06.704082 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:06.704531 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:07.069267 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:07.076963 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-61c5c5a5-a792-4ef5-b51e-78eb76d158be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1579 microversion: 2.1 time: 0.387870 Nov 22 13:53:07.078112 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 586/1154] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:06 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1579 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:08.095578 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:08.096277 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:08.102808 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:08.103266 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:08.104046 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:08.104485 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:08.238928 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:08.246212 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dfd95c4e-2f2b-4817-af99-133b92582d18 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1460 microversion: 2.1 time: 0.154645 Nov 22 13:53:08.246785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 569/1155] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:08 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:09.015754 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-4869ab5d-eaf9-4102-8598-1237c117bf47 req-b4155892-79fb-491d-8e6e-1838306530ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c96b11-877d-4f0a-8092-d54a9d9d1bb9", "name": "network-vif-deleted", "tag": "46d2159e-1a72-4e7c-ac55-097dbb7f1756"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:53:09.017326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:53:09.017326 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:53:09.025438 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-4869ab5d-eaf9-4102-8598-1237c117bf47 req-b4155892-79fb-491d-8e6e-1838306530ee service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:09.025879 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-4869ab5d-eaf9-4102-8598-1237c117bf47 req-b4155892-79fb-491d-8e6e-1838306530ee service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:09.037964 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-4869ab5d-eaf9-4102-8598-1237c117bf47 req-b4155892-79fb-491d-8e6e-1838306530ee service nova] Creating event network-vif-deleted:46d2159e-1a72-4e7c-ac55-097dbb7f1756 for instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 on hv-cinder-76845 Nov 22 13:53:09.042846 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-4869ab5d-eaf9-4102-8598-1237c117bf47 req-b4155892-79fb-491d-8e6e-1838306530ee service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030707 Nov 22 13:53:09.043458 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 587/1156] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:53:09.263416 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:09.264026 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:09.272601 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:09.273215 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:09.274044 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:09.274501 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:09.337117 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:09.345981 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-3d22c90a-29f0-49c9-9538-b50e4c94a029 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 200 len: 1226 microversion: 2.1 time: 0.086192 Nov 22 13:53:09.356155 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 570/1157] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:09 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:10.365046 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:10.365774 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: e1c96b11-877d-4f0a-8092-d54a9d9d1bb9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:10.373344 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:10.373800 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:10.374567 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:10.375000 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:10.388336 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] HTTP exception thrown: Instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 could not be found. Nov 22 13:53:10.388909 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Returning 404 to user: Instance e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:10.389740 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-a32f26de-3f96-478f-be2d-2e06ea5da0e0 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9" status: 404 len: 111 microversion: 2.1 time: 0.029691 Nov 22 13:53:10.390261 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 588/1158] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:10 2021] GET /compute/v2.1/servers/e1c96b11-877d-4f0a-8092-d54a9d9d1bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:13.430248 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:13.430880 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:13.433951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-b1f2fadf-9449-47f6-932f-417fd480ac8c req-3267cd58-b54b-4d9c-9c03-5565c8d99303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1219c4a2-cb56-4f49-bb5e-6da279f573b9", "tag": "07e4c4a6-639b-4da1-8b31-c75191903b37"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:53:13.435685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:53:13.435685 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:53:13.436741 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:13.437188 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:13.438041 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:13.438415 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:13.443782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-b1f2fadf-9449-47f6-932f-417fd480ac8c req-3267cd58-b54b-4d9c-9c03-5565c8d99303 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:13.444288 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-b1f2fadf-9449-47f6-932f-417fd480ac8c req-3267cd58-b54b-4d9c-9c03-5565c8d99303 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:13.455263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-b1f2fadf-9449-47f6-932f-417fd480ac8c req-3267cd58-b54b-4d9c-9c03-5565c8d99303 service nova] Creating event network-changed:07e4c4a6-639b-4da1-8b31-c75191903b37 for instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 on hv-cinder-76845 Nov 22 13:53:13.464440 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Going to try to terminate instance {{(pid=122684) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:53:13.464679 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-b1f2fadf-9449-47f6-932f-417fd480ac8c req-3267cd58-b54b-4d9c-9c03-5565c8d99303 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035290 Nov 22 13:53:13.465509 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 589/1159] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:53:13.554652 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d8010ba1-27ee-4b3c-9678-67c4bbc69a5f tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 204 len: 0 microversion: 2.1 time: 0.127842 Nov 22 13:53:13.555642 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 571/1160] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:53:13 2021] DELETE /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 13:53:13.564270 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:13.564982 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:13.571347 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:13.571808 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:13.572611 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:13.573051 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:13.807025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:13.814649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f0507533-c386-4788-a865-ca4b87b278a1 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1578 microversion: 2.1 time: 0.254566 Nov 22 13:53:13.815726 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 590/1161] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:13 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:14.832625 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:14.833362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:14.839774 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:14.840165 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:14.840942 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:14.841426 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:14.980690 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:14.992608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-b48710d6-6ca7-47bd-9f36-25bcc507e5cc tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1459 microversion: 2.1 time: 0.161408 Nov 22 13:53:14.992608 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 572/1162] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:14 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:15.741542 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [req-d00cf730-3079-420a-9036-5c2d1e0888c4 req-fdbf42cb-6189-42c6-8e4d-164adece24e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219c4a2-cb56-4f49-bb5e-6da279f573b9", "name": "network-vif-deleted", "tag": "07e4c4a6-639b-4da1-8b31-c75191903b37"}]} {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:53:15.743084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:53:15.743084 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: warnings.warn(msg) Nov 22 13:53:15.750398 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-d00cf730-3079-420a-9036-5c2d1e0888c4 req-fdbf42cb-6189-42c6-8e4d-164adece24e0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:15.750849 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [req-d00cf730-3079-420a-9036-5c2d1e0888c4 req-fdbf42cb-6189-42c6-8e4d-164adece24e0 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:15.763449 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.compute.server_external_events [req-d00cf730-3079-420a-9036-5c2d1e0888c4 req-fdbf42cb-6189-42c6-8e4d-164adece24e0 service nova] Creating event network-vif-deleted:07e4c4a6-639b-4da1-8b31-c75191903b37 for instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 on hv-cinder-76845 Nov 22 13:53:15.769571 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [req-d00cf730-3079-420a-9036-5c2d1e0888c4 req-fdbf42cb-6189-42c6-8e4d-164adece24e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Nov 22 13:53:15.770371 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 591/1163] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:53:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:15.893161 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:15.895145 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:15.901439 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:15.901886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:15.902656 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:15.903087 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:15.931338 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-f128e56a-e564-4d6a-8ed9-5777d5d132f8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041948 Nov 22 13:53:15.931984 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 573/1164] 10.222.0.31 () {60 vars in 1342 bytes} [Mon Nov 22 13:53:15 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:15.987776 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:15.988370 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:15.994508 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:15.994967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:15.995823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:15.996270 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:16.008025 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:16.008386 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:16.015585 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:16.016047 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:16.017049 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:16.017844 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:16.035920 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Going to try to terminate instance {{(pid=122685) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 13:53:16.095751 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b9ef5f3674c13b98a9ce5e30923f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accea9af00354befabcdcf4325a007ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:16.103952 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-dda909b1-0a3d-4304-be07-a0f6b6c2c7f7 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 200 len: 1226 microversion: 2.1 time: 0.100271 Nov 22 13:53:16.104634 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 574/1165] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:16 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 13:53:16.130025 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-42d50070-7227-44b6-b64d-a8f347e62df4 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 204 len: 0 microversion: 2.20 time: 0.146025 Nov 22 13:53:16.130868 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 592/1166] 10.222.0.31 () {60 vars in 1279 bytes} [Mon Nov 22 13:53:15 2021] DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 13:53:16.140544 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:16.142093 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:16.150205 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:16.150897 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:16.151726 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:16.152170 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:16.292897 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:16.300630 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:16.302152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:16.303318 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-d0bbb808-ffd2-4e07-b5aa-587ff48a5688 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.168213 Nov 22 13:53:16.303883 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 575/1167] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:53:16 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 13:53:17.121649 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:17.122345 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: 1219c4a2-cb56-4f49-bb5e-6da279f573b9] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:17.129448 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.129898 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.130672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.131101 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.147782 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] HTTP exception thrown: Instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 could not be found. Nov 22 13:53:17.148359 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Returning 404 to user: Instance 1219c4a2-cb56-4f49-bb5e-6da279f573b9 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:17.149157 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-524cb17f-9bc4-4ac8-96be-e87e494e61d4 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9" status: 404 len: 111 microversion: 2.1 time: 0.031739 Nov 22 13:53:17.149709 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 593/1168] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:17 2021] GET /compute/v2.1/servers/1219c4a2-cb56-4f49-bb5e-6da279f573b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:17.321456 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:17.322068 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:17.328253 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.328698 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.329510 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.329945 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.533216 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:17.541072 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:17.542566 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.policy [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122684) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:17.543709 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-4fc821af-e22b-495b-ab49-ead89da4efee tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1720 microversion: 2.20 time: 0.226013 Nov 22 13:53:17.544337 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 576/1169] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:53:17 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:53:17.675992 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:17.676490 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:17.682321 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.682763 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.683525 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.683953 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.697175 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] HTTP exception thrown: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. Nov 22 13:53:17.697777 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Returning 404 to user: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:17.698566 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-03dcf28b-0fe8-4e7c-bf5d-1d55a09f345b tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 404 len: 111 microversion: 2.1 time: 0.027028 Nov 22 13:53:17.699091 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 594/1170] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:53:17 2021] DELETE /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:17.706910 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:17.707503 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [instance: ad79f610-9b3d-4c71-a797-2b9ec9602b6c] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:17.713334 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.713785 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.714552 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:17.714999 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:17.727879 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] HTTP exception thrown: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. Nov 22 13:53:17.728464 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Returning 404 to user: Instance ad79f610-9b3d-4c71-a797-2b9ec9602b6c could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:17.729306 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-c60f8042-2e45-49bb-b5f7-91ac8c036522 tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c" status: 404 len: 111 microversion: 2.1 time: 0.026069 Nov 22 13:53:17.729854 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 577/1171] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:17 2021] GET /compute/v2.1/servers/ad79f610-9b3d-4c71-a797-2b9ec9602b6c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:18.561655 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:18.562374 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:18.569967 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:18.570702 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:18.571712 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:18.572557 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:18.586820 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [req-5a135f20-ed30-4e1a-a180-aa3adfc596dd req-d4108846-97a9-4c98-bcd6-7d738fa0c061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fb652e-5293-4626-abe6-4731dc711ce3", "name": "network-vif-deleted", "tag": "0ca96122-e5c9-4d4e-88ed-dc773b45578e"}]} {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 13:53:18.589094 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 13:53:18.589094 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: warnings.warn(msg) Nov 22 13:53:18.596885 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5a135f20-ed30-4e1a-a180-aa3adfc596dd req-d4108846-97a9-4c98-bcd6-7d738fa0c061 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:18.597886 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [req-5a135f20-ed30-4e1a-a180-aa3adfc596dd req-d4108846-97a9-4c98-bcd6-7d738fa0c061 service nova] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:18.610409 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.compute.server_external_events [req-5a135f20-ed30-4e1a-a180-aa3adfc596dd req-d4108846-97a9-4c98-bcd6-7d738fa0c061 service nova] Creating event network-vif-deleted:0ca96122-e5c9-4d4e-88ed-dc773b45578e for instance f8fb652e-5293-4626-abe6-4731dc711ce3 on hv-cinder-76845 Nov 22 13:53:18.616396 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [req-5a135f20-ed30-4e1a-a180-aa3adfc596dd req-d4108846-97a9-4c98-bcd6-7d738fa0c061 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047793 Nov 22 13:53:18.616991 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 578/1172] 10.222.0.31 () {64 vars in 1317 bytes} [Mon Nov 22 13:53:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:18.656583 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:18.667951 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:18.669973 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.policy [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a3fab5efa2467d85df830cf8b70c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa9b67016f4c04b4aaa3c5f141bc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122685) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 13:53:18.671301 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-71d73915-876b-4910-a615-67645158b4d8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 200 len: 1652 microversion: 2.20 time: 0.113387 Nov 22 13:53:18.672089 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 595/1173] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:53:18 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 1652 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 13:53:19.014977 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-20ec3962-5a1d-4cdf-8e53-d7d1bf1873be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] Calling method '.version_select at 0x7f6740360ca0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:19.018179 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20ec3962-5a1d-4cdf-8e53-d7d1bf1873be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [58345ccb-f1cd-462b-8a5f-62e72778bd5a] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 13:53:19.691070 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:19.691704 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:19.697892 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:19.698336 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:19.699098 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:19.699527 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:19.712708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. Nov 22 13:53:19.713363 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:19.714161 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-fe4cf0ad-3043-4df1-85e4-3645742f6d22 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 404 len: 111 microversion: 2.20 time: 0.027487 Nov 22 13:53:19.714671 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 596/1174] 10.222.0.31 () {60 vars in 1276 bytes} [Mon Nov 22 13:53:19 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 22 13:53:19.723033 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6a1dba81-1bef-4b65-ab61-5443fc07860c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '.version_select at 0x7f673da47310>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:19.740349 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6a1dba81-1bef-4b65-ab61-5443fc07860c tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958490198" status: 204 len: 0 microversion: 2.20 time: 0.021372 Nov 22 13:53:19.740887 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 597/1175] 10.222.0.31 () {60 vars in 1258 bytes} [Mon Nov 22 13:53:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958490198 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 22 13:53:20.034706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [None req-20ec3962-5a1d-4cdf-8e53-d7d1bf1873be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] [58345ccb-f1cd-462b-8a5f-62e72778bd5a] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 37466. Nov 22 13:53:20.052388 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-20ec3962-5a1d-4cdf-8e53-d7d1bf1873be tempest-TestVolumeBootPattern-1167811832 tempest-TestVolumeBootPattern-1167811832-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1445698613" status: 202 len: 0 microversion: 2.1 time: 1.041352 Nov 22 13:53:20.053232 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 579/1176] 10.222.0.31 () {58 vars in 1262 bytes} [Mon Nov 22 13:53:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1445698613 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 13:53:21.505767 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:21.507472 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:21.516708 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:21.517588 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:21.518844 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:21.519651 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:21.537341 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. Nov 22 13:53:21.538263 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:21.539592 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-b93bbbd5-b0e6-42ac-927c-92e0b546c8ba tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 404 len: 111 microversion: 2.1 time: 0.038375 Nov 22 13:53:21.551259 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:21.552912 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: f8fb652e-5293-4626-abe6-4731dc711ce3] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:21.558119 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 598/1177] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:53:21 2021] DELETE /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:21.560204 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:21.560655 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:21.561651 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:21.562268 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:21.577694 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. Nov 22 13:53:21.579135 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance f8fb652e-5293-4626-abe6-4731dc711ce3 could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:21.580202 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-bbe54400-94d9-4021-b88c-78870e4ca785 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3" status: 404 len: 111 microversion: 2.1 time: 0.035546 Nov 22 13:53:21.585050 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 580/1178] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:21 2021] GET /compute/v2.1/servers/f8fb652e-5293-4626-abe6-4731dc711ce3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:22.708624 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:22.709160 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.compute.api [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122685) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:22.715254 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:22.715697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:22.716471 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:22.716903 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG oslo_concurrency.lockutils [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:22.729755 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.wsgi [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. Nov 22 13:53:22.730338 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. {{(pid=122685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:22.731147 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f30ef256-2567-4d65-8fd8-53293e9b6f05 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 404 len: 111 microversion: 2.1 time: 0.026725 Nov 22 13:53:22.731690 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 599/1179] 10.222.0.31 () {58 vars in 1238 bytes} [Mon Nov 22 13:53:22 2021] DELETE /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:22.739487 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Calling method '>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:22.740134 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.compute.api [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] [instance: 1d5dba29-802d-4100-bda9-b5f5ce333fce] Fetching instance by UUID {{(pid=122684) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 13:53:22.746516 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:22.746972 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:22.747754 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 13:53:22.748190 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG oslo_concurrency.lockutils [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Lock "c5a3ccc7-7498-4e42-bdb0-56f137d23b0d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 13:53:22.762528 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.wsgi [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] HTTP exception thrown: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. Nov 22 13:53:22.763119 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] Returning 404 to user: Instance 1d5dba29-802d-4100-bda9-b5f5ce333fce could not be found. {{(pid=122684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 13:53:22.764013 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-1b96fe4c-1463-41ec-8d2e-bf2dc2a0ded8 tempest-AttachVolumeShelveTestJSON-1045329862 tempest-AttachVolumeShelveTestJSON-1045329862-project] 10.222.0.31 "GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce" status: 404 len: 111 microversion: 2.1 time: 0.028281 Nov 22 13:53:22.764706 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 581/1180] 10.222.0.31 () {58 vars in 1235 bytes} [Mon Nov 22 13:53:22 2021] GET /compute/v2.1/servers/1d5dba29-802d-4100-bda9-b5f5ce333fce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 13:53:29.598271 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-9a897029-07f5-4aec-9944-d1b7331b3c23 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673db71550>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:29.643792 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-9a897029-07f5-4aec-9944-d1b7331b3c23 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/87fb643e-3e57-4e2c-9510-c79f3284e1f4" status: 200 len: 350 microversion: 2.1 time: 0.049536 Nov 22 13:53:29.644347 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 600/1181] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:53:29 2021] GET /compute/v2.1/os-volumes/87fb643e-3e57-4e2c-9510-c79f3284e1f4 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:30.943152 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-be653062-c92f-4e73-87da-380b6de40a3e tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673dbd4280>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:30.988048 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-be653062-c92f-4e73-87da-380b6de40a3e tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/8b43279b-9ff9-4a53-90fa-871171a5f381" status: 200 len: 351 microversion: 2.1 time: 0.048935 Nov 22 13:53:30.988612 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 582/1182] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:53:30 2021] GET /compute/v2.1/os-volumes/8b43279b-9ff9-4a53-90fa-871171a5f381 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:32.285547 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-796eda36-7b74-4d67-a652-35620699a910 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673dca84c0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.330044 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-796eda36-7b74-4d67-a652-35620699a910 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/597c2535-09c4-4978-903d-40d723ecb417" status: 200 len: 351 microversion: 2.1 time: 0.049243 Nov 22 13:53:32.330612 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 601/1183] 10.222.0.31 () {58 vars in 1244 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes/597c2535-09c4-4978-903d-40d723ecb417 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:32.341748 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-7d9586e3-2681-49b1-9f0a-9ce56641a009 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673de331f0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.425406 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-7d9586e3-2681-49b1-9f0a-9ce56641a009 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087539 Nov 22 13:53:32.425988 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 583/1184] 10.222.0.31 () {58 vars in 1133 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:32.438253 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-c619a19e-a9c3-48c9-b18b-891e6386af48 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673daf78b0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.518222 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-c619a19e-a9c3-48c9-b18b-891e6386af48 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082878 Nov 22 13:53:32.518820 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 602/1185] 10.222.0.31 () {58 vars in 1148 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:32.530220 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-31a8fa5d-8e81-419a-81bf-056a42df3fdb tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673d9ae1f0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.608362 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-31a8fa5d-8e81-419a-81bf-056a42df3fdb tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081620 Nov 22 13:53:32.608930 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 584/1186] 10.222.0.31 () {58 vars in 1133 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:32.619924 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-f723d09d-dbf4-4456-b2ed-5ddc2abc7014 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673db718b0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.698442 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-f723d09d-dbf4-4456-b2ed-5ddc2abc7014 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081963 Nov 22 13:53:32.698999 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 603/1187] 10.222.0.31 () {58 vars in 1166 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:32.710922 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-95e89d71-6088-40da-845e-6d238ef4d678 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673dbb3ca0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.789713 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-95e89d71-6088-40da-845e-6d238ef4d678 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082244 Nov 22 13:53:32.790295 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 585/1188] 10.222.0.31 () {58 vars in 1169 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 13:53:32.801697 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-6909364a-c81e-4f21-97f7-17e6d9f313e2 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673da47ca0>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.878672 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-6909364a-c81e-4f21-97f7-17e6d9f313e2 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080444 Nov 22 13:53:32.879248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 604/1189] 10.222.0.31 () {58 vars in 1154 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:32.889839 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: DEBUG nova.api.openstack.wsgi [None req-2016409c-bc2c-4a0f-b509-c1be8d5fb25a tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673da2bee0>' {{(pid=122684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:32.966969 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO nova.api.openstack.requestlog [None req-2016409c-bc2c-4a0f-b509-c1be8d5fb25a tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.080598 Nov 22 13:53:32.967542 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: [pid: 122684|app: 0|req: 586/1190] 10.222.0.31 () {58 vars in 1187 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 13:53:32.979276 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: DEBUG nova.api.openstack.wsgi [None req-e63c2fdc-da37-4626-bd7c-b917888c6660 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] Calling method '.version_select at 0x7f673da98f70>' {{(pid=122685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 13:53:33.057950 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO nova.api.openstack.requestlog [None req-e63c2fdc-da37-4626-bd7c-b917888c6660 tempest-VolumesTestJSON-198509611 tempest-VolumesTestJSON-198509611-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082104 Nov 22 13:53:33.058526 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: [pid: 122685|app: 0|req: 605/1191] 10.222.0.31 () {58 vars in 1154 bytes} [Mon Nov 22 13:53:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 13:53:43.097805 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:53:43.098325 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: Mon Nov 22 13:53:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:55:24.577823 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:55:24.578381 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: Mon Nov 22 13:55:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:57:03.116269 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:57:03.116921 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: Mon Nov 22 13:57:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:58:20.275988 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:58:20.276631 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: Mon Nov 22 13:58:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:58:44.595638 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:58:44.596248 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: Mon Nov 22 13:58:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:58:48.504113 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:58:48.504650 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: Mon Nov 22 13:58:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:59:02.860806 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:59:02.861324 dv-cinder-768458-14-iscsi devstack@n-api.service[122685]: Mon Nov 22 13:59:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 13:59:05.257280 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 13:59:05.257826 dv-cinder-768458-14-iscsi devstack@n-api.service[122684]: Mon Nov 22 13:59:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!